You can make a small DOS batch file to use as your Condor “executable”.
This batch file would copy across any files it needs, run the “real” executable, copy any results back, and clean up after itself. This then removes the burden of file transfers from the submit node to each of the individual execute nodes. Cheers Greg From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx]
On Behalf Of Dennis Zheleznyak Hi everyone, I have a small cluster that consists of 5 Windows machines. The data it self sits on the domain controller of the environment, all the machines have a network mapped drive named L:\. When submitting a lot of jobs, the submit machine copies the data from the network mapped drive to the "work" nodes - which is a huge drawback, the load on the network is huge and jobs can't start running since most of them are waiting
to be copied. Is there any way to make the "work" nodes copy the data them selves instead of giving the submit to do that ? Thank you, Dennis. |