Re: [HTCondor-users] Jobs staying idle, need to set the default memory in HTCondor-CE

[Jaime Frey <jfrey@xxxxxxxxxxx>]

You can set maxMemory=RequestMemory in your glidein jobs. That takes precedence in the CEâs routing rules for memory.

Another option is the switch to the new routing syntax (which youâll have to do before 24.0 later this year). Then, you can alter the job memory rules by dropping a new config file in /etc/condor-ce/config.d/.

 - Jaime

> On Apr 20, 2024, at 7:35âPM, Marco Mambelli via HTCondor-users <htcondor-users@xxxxxxxxxxx> wrote:
> 
> Greetings,
> Iâm using a small one-node cluster for testing purposes.
> Iâm unable to run successfully Glidein jobs when the node has only 2GB or less.
> 
> The jobs submitted, Glideins, have the following required memory (min required) that is minimal
> ImageSize = 100
> ImageSize_RAW = 100
> RequestMemory = ifthenelse(MemoryUsage =!= undefined,MemoryUsage,(ImageSize + 1023) / 1024)
> 
> But the router defaults in /usr/share/condor-ce/condor_ce_router_defaults kick in and specifically the expression
>    eval_set_OriginalMemory = ifThenElse(maxMemory isnt undefined,
>                                         maxMemory,
>                                         ifThenElse(default_maxMemory isnt undefined,
>                                                    default_maxMemory,
>                                                    2000));
> In JOB_ROUTER_DEFAULTS_GENERATED @=jrd
> 
> This set the required memory to 2000 and the job cannot start on the local condor because of the Machine requirements:
> Requirements = START && (WithinResourceLimits)
> WithinResourceLimits = (MY.Cpus > 0 && TARGET.RequestCpus <= MY.Cpus && MY.Memory > 0 && TARGET.RequestMemory <= MY.Memory && MY.Disk > 0 && TARGET.RequestDisk <= MY.Disk && (TARGET.RequestGPUs =?= undefined || MY.GPUs >= TARGET.RequestGPUs))
> 
> Is there a way I could change the default_maxMemory by adding the value in a config file?
> 
> set_default_maxMemory works within a routing policy but  Iâd like to avoid to write custom routing policies if possible. 
> And Iâd prefer not to edit /usr/share/condor-ce/condor_ce_router_defaults 
> 
> Thank you,
> Marco