Re: [HTCondor-users] Control jobs per user

[Jaime Frey <jfrey@xxxxxxxxxxx>]

Do you want to limit the number of jobs submitted to HTCondor for each user, or how many jobs HTCondor will run at a time for each user? You can limit the number of jobs that can be submitted, but additional submission attempts for the user will fail, which may cause Cromwell to think HTCondor is broken.

HTCondor has several mechanisms to control how many of the computing resources can be used by each user, regardless of how many jobs each has submitted. Thus, you can allow Cromwell to submit as many jobs as it wants and ensure one user doesnât monopolize the glideins in SLURM.

If all of the jobs are submitted to HTCondor under the same user account, then you can set accounting_group_user in the HTCondor submit description file. This changes the identifier used for scheduling and accounting purposes.

The details of how HTCondor schedules jobs can be found here: https://htcondor.readthedocs.io/en/latest/admin-manual/cm-configuration.html#configuration-and-operation-of-the-negotiator

In brief, HTCondor attempts to ensure each user gets a âfair shareâ of the compute resources currently available. Jobs are not run in a strict FIFO order. You can configure many of the details of how the resources are divided amongst the users, including giving some users a larger share and setting a max amount that each user can use at a time.

 - Jaime

On Oct 22, 2024, at 3:34âPM, Seung-Jin Sul <ssul@xxxxxxx> wrote:

Hi,

We are using Cromwell as a workflow engine and HTCondor as a backend. We have tried to throttle the number of jobs submitted to HTCondor from the Cromwell level using HogGroup and HogFactor but it's not working for use as intended.

The compute resource for our HTCondor is configured as a glide-in with SLURM. Thus, our HTCondor is run by a single-user account. So, we're seeking to pass the user's account name with the submission and then control the number of submissions from the HTCondor scheduler side. Can we limit the number of submissions per user from HTCondor?

Thank you!

Seung Sul