Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] a question about machines in the pool and slots handling
- Date: Mon, 23 Aug 2021 12:31:16 +0000
- From: "Valdes, Julio" <Julio.Valdes@xxxxxxxxxxxxxx>
- Subject: Re: [HTCondor-users] a question about machines in the pool and slots handling
Hello Thomas:
Thank you very much for responding and for considering my problem.
Are those instructions that you sent something that I should add to my condor submission file ( I could send you the file if you would like to inspect it), or within the (condor_config) file loaded when the condor service starts?.
Thank you
Julio J. Valdés
National Research Council Canada | Conseil National de Recherches Canada
Digital Technologies Research Centre | Centre de Recherche en Technologies Numériques
Data Science for Complex Systems Group | Science des Données pour les Systèmes Complexes
M-50, 1200 Montreal Road, Ottawa, Ontario K1A 0R6 | M-50, 1200 chemin Montréal, Ottawa, Ontario K1A 0R6
Canada | Canada
julio.valdes@xxxxxxxxxxxxxx
tel/tél: (1)613-993-0257
-----Original Message-----
From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf Of Thomas Hartmann
Sent: Monday, August 23, 2021 8:06 AM
To: htcondor-users@xxxxxxxxxxx
Subject: Re: [HTCondor-users] a question about machines in the pool and slots handling
***ATTENTION*** This email originated from outside of the NRC. ***ATTENTION*** Ce courriel provient de l'extérieur du CNRC
Hi Julio,
you might be able to realize it with CONSUMPTION policies [1], with which you could set different slot types each to a specific number of cores but keep them partitionable to also attract smaller jobs without too much waste (but I am not 100% sure).
Cheers,
Thomas
[1]
SLOT_TYPE_1 = cpu=4
SLOT_TYPE_1_PARTITIONABLE = true ## should make the slot accept jobs with cores between 1 and 4 ## SLOT_TYPE_1_CONSUMPTION_POLICY = false
https://htcondor.readthedocs.io/en/latest/admin-manual/policy-configuration.html?highlight=condor_negotiator-Side%20Resource%20Consumption%20Policies%20#condor-negotiator-side-resource-consumption-policies
On 23/08/2021 11.41, Valdes, Julio wrote:
> Hello:
>
> I have a condor pool with machines having different numbers of CPUs
> each
> (Ex: machine A has 16 cpus, machine B 32 cpus and so on).
>
> The scenario is that I want to be able to somehow specify that only 4
> CPUS max must be used from machine A, 10 from machine B and so on.
>
> A more elaborated reformulation of the above would be:
>
> How could I write a ClassAd requirement indicating that from machine A
> I want to use only slots 3, 4 and 5, from machine B slots 23, 25, 27
> and 28, say?.
>
> All of that, within a condor submission file.
>
> Is that possible?.
>
> If so, Could anyone provide an example of a requirement (or rank)
> statement implementing the aforementioned specification?.
>
> I tried to google this issue in many ways, unsuccessfully. I also went
> through the condor manuals, but I was not able either to find the
> answer or to understand the material so that I could construct the answer myself.
>
> Any help would be much appreciated.
>
> Thank you in advance
>
> Julio J. Valdés
>
> National Research Council Canada |
> Conseil National de Recherches Canada
>
> Digital Technologies Research Centre |
> Centre de Recherche en Technologies Numériques
>
> Data Science for Complex Systems Group | Science
> des Données pour les Systèmes Complexes
>
> M-50, 1200 Montreal Road, Ottawa, Ontario K1A 0R6 | M-50, 1200 chemin
> Montréal, Ottawa, Ontario K1A 0R6
>
> Canada
> |
> Canada
>
> julio.valdes@xxxxxxxxxxxxxx <mailto:julio.valdes@xxxxxxxxxxxxxx>
>
> tel/tél: (1)613-993-0257
>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx
> with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/
>