[Condor-users] submitting large amount of jobs which use the same input file

["Ittach, Yossi" <yossi.ittach@xxxxxxxxx>]

Hey

 

I need to run a lot (approx. 4000) jobs which use the same input file, only with different parameters.

We don’t have nfs.

How can I distribute the amount of system calls to the computer? I fear that if too much machines will run those jobs at the same time, and will perform multiple I/O system calls simultaneously, the connection will crush. (or will automatically disconnect due to network regulation). I know I can limit the amount of jobs which run at the same time, but isn’t there a more efficient way?

 

 Thanks!

 

Vale et me ama

Yossi