Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] submitting all jobs with DAGMan
- Date: Mon, 10 May 2010 10:06:43 -0400
- From: Matthew Farrellee <matt@xxxxxxxxxx>
- Subject: Re: [Condor-users] submitting all jobs with DAGMan
On 04/28/2010 11:13 AM, Ian Chesal wrote:
> On Wed, Apr 28, 2010 at 9:55 AM, R. Kent Wenger <wenger@xxxxxxxxxxx
> <mailto:wenger@xxxxxxxxxxx>> wrote:
>
> Another idea along these lines -- I had thought of adding a feature
> to allow condor_submit_dag to work directly with the submit files
> (without a DAG file) for the case where you just want to use DAGMan
> to throttle independent jobs. Maybe something like this:
>
> condor_submit_dag -sub A.sub B.sub C.sub ...
>
> Would people find this useful? (All it would mean is that you
> wouldn't have to bother to make the degenerate DAG file.)
>
>
> I think that would be useful.
>
> Mag, if you need global throttling for independent jobs of a certain
> type you can look in to resource limits in Condor. I'm trying to find a
> link to documentation about this, but I can't seem to locate it in the
> index of the 7.2 or 7.4 docs. I know Condor now has global counters you
> can use to represent resources (like licenses) that jobs will "claim"
> and decrement if they run. You could use these to throttle concurrency...
>
> - Ian
http://www.cs.wisc.edu/condor/manual/v7.2/3_13Setting_Up.html#35848
http://www.cs.wisc.edu/condor/manual/v7.4/3_13Setting_Up.html#35598
http://www.cs.wisc.edu/condor/manual/v7.5/3_13Setting_Up.html#36409
The section bounced around.