Re: [HTCondor-users] Using MAXJOBS in a DAG configuration file

[Nicolas Arnaud <nicolas.arnaud@xxxxxxxxxxxxxxx>]

Hi Cole,

In my case I need the fine-grained throttling. The command

> MAXJOBS CategoryName MaxJobsValue

works fine in included in the DAG file, but not if I move it to the file

> /some/path/to/dag.config

and read this file with

> CONFIG /some/path/to/dag.config

in the DAG file.

So I'm just asking whether there is a way to move that command from the 
DAG file to the config file the DAG file is calling.

Cheers,

Nicolas

Le 27/11/2023 Ã 16:02, Cole Bollig via HTCondor-users a ÃcritÂ:
> Hi Nicholas,
>
> Per DAG configuration can apply the job throttling limits for the DAG as 
> a whole while the MAXJOBS command allows for more fine-grained 
> throttling (i.e. grouping nodes into a category and throttling per 
> category). So if you don't need the fine-grained per category 
> throttling, you can use either of the following DAGMan configuration 
> options:
>
> DAGMAN_MAX_JOBS_IDLE = <N>
> DAGMAN_MAX_JOBS_SUBMITTED = <N>
>
> The difference between these two options is the max idle works on a job 
> proc limit while the max jobs submitted works on a job cluster limit.
>
> Hope this helps,
> Cole Bollig
> ------------------------------------------------------------------------
> *From:* HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of 
> Nicolas Arnaud <nicolas.arnaud@xxxxxxxxxxxxxxx>
> *Sent:* Monday, November 27, 2023 4:21 AM
> *To:* HTCondor Users <htcondor-users@xxxxxxxxxxx>
> *Subject:* [HTCondor-users] Using MAXJOBS in a DAG configuration file
>
> Hello,
>
> Is it possible to include the DAG input file command
>
> > MAXJOBS CategoryName MaxJobsValue
>
> in a DAG configuration file which is read by the command
>
> > CONFIG /path/to/dag.config
>
> ? If yes, what would be the syntax?
>
> Thanks in advance,
>
> Nicolas
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users 
> <https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users>
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/ 
> <https://lists.cs.wisc.edu/archive/htcondor-users/>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/

--

============================================
= Nicolas ARNAUD                           =
=                                          =
= Laboratoire de physique des deux infinis =
= IrÃne Joliot-Curie (IJCLab)              =
= CNRS/IN2P3 & Università Paris-Saclay     =
=                                          =
= Virgo Experiment                         =
=                                          =
= European Gravitational Observatory (EGO) =
= Via E. Amaldi, 5                         =
= Building 4, room P10                     =
= 56021 Santo Stefano a Macerata           =
= Cascina (PI) -- Italia                   =
= Tel: + 39 050 752 314                    =
============================================