Re: [Condor-users] TransferOutputFiles and the parallel universe

[Ian Cottam <ian.cottam@xxxxxxxxxxxxxxxx>]

Can you create a temp folder dynamically -say from a batch command file- and store all the files in there that you don't want copying back? The results file should just be in the normal working folder. Folders created at run time are not copied back. 

-Ian




On 5 Mar 2011, at 11:03, Felix Wolfheimer <f.wolfheimer@xxxxxxxxxxxxxx> wrote:

> I'm using Condor on a pool of Windows machines which don't have a shared
> file system and, thus, use Condors file transfer mechanism. I'm using a
> software which spawns processes on different nodes of the pool using MPI
> and the master process of the software writes a result file. So I have
> the following situation: 
> 
> On the master node there is the result file I'm interested in plus a lot
> of temporary stuff created during the program run which can be
> discarded. On the worker nodes there is only stuff created which I'm not
> interested in. So the only file I want to transfer back after the job
> has finished is the output file from the master node (=first node in the
> list of AllRemoteHosts). 
> I tried to use the TransferOutputFile ad but this leads to an error
> message because apparently all the nodes try to transfer back the file
> and not only the master. Is there a way to tell Condor either to
> transfer back the file only if it exists or to limit the
> TransferOutputFile to just the master?   
> 
> 
> 
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/