[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Condor-users] Master-worker with condor
- Date: Thu, 10 Jun 2010 00:22:06 +0100
- From: John Pybus <john.pybus@xxxxxxxxxxxxx>
- Subject: [Condor-users] Master-worker with condor
Hi,
We have some workloads which involve a central process exploring
parameter space by partitioning out trial calculations then receiving
the result before deciding on new parameters for the next iteration.
This can use as many threads as are available, so the number of workers
would depend on how many slots are available in the pool rather than
deciding at submission time as with the parallel universe.
This style seems well captured by the Master-Worker workflow documented
at http://www.cs.wisc.edu/condor/mw/ . However MW seems to use
Condor-PVM which has disappeared in recent condor versions, and those
pages haven't been updated in years. Is MW still supported? Does
anyone else do M-W style computation with condor, if so what software do
you use?
Thanks,
John