Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] DAGMan low submission rate
- Date: Tue, 04 Jul 2017 20:00:15 -0500
- From: Brian Bockelman <bbockelm@xxxxxxxxxxx>
- Subject: Re: [HTCondor-users] DAGMan low submission rate
Hi Henning,
If I recall the setup, I think we:
a) Created an executable /usr/share/condor/condor_submit_wrapper with the following contents:
#!/bin/sh
export _condor_SUBMIT_SEND_RESCHEDULE=false
exec condor_submit "$@"
b) Set DAGMAN_CONDOR_SUBMIT_EXE=/usr/share/condor/condor_submit_wrapper in the HTCondor configuration file.
Brian
> On Jul 4, 2017, at 9:58 AM, Henning Fehrmann <henning.fehrmann@xxxxxxxxxx> wrote:
>
> On Mon, Jul 03, 2017 at 02:26:40PM -0500, Brian Bockelman wrote:
>
> Hi Brian,
>
>> One trick we did in CMS is to wrap condor_submit with a small bash script
>> that uses an environment variable to disable the implicit
>> condor_reschedule. This way, raw "condor_submit" gets the default
>> behavior while dagman-based submits are more optimized.
>> It's been two years, so I forget the raw speedup - but I recall it being
>> quite impressive.
>> Brian
>> PS - see
>> also [1]https://htcondor-wiki.cs.wisc.edu/index.cgi/tktview?tn=5164
>>
>
> That seems to be something we should try.
> Do you recall the environment variable?
> It wasn't
> export SUBMIT_SEND_RESCHEDULE=FALSE
> or
> export _CONDOR_SUBMIT_SEND_RESCHEDULE=FALSE
> or so?
>
> Cheers,
> Henning
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/