[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Condor-users] Master-worker with condor



Hi,

We have some workloads which involve a central process exploring parameter space by partitioning out trial calculations then receiving the result before deciding on new parameters for the next iteration. This can use as many threads as are available, so the number of workers would depend on how many slots are available in the pool rather than deciding at submission time as with the parallel universe.
This style seems well captured by the Master-Worker workflow documented 
at http://www.cs.wisc.edu/condor/mw/ .  However MW seems to use 
Condor-PVM which has disappeared in recent condor versions, and those 
pages haven't been updated in years.  Is MW still supported?  Does 
anyone else do M-W style computation with condor, if so what software do 
you use?
Thanks,
John