Mailing List ArchivesAuthenticated access |
![[Computer Systems Lab]](http://www.cs.wisc.edu/pics/csl_logo.gif){kind=logo}
|
Mailing List ArchivesAuthenticated access |
|
Hello Seung-jin,
Another way to limit how many cores a single user can utilize is to use "condor_userprio -setceil" command.
...Tim
Hi Jaime,
Thank you for the info.We need to prevent a user from using all the HTCondor compute resources. So it's the latter. We want to control `how many jobs HTCondor will run at a time for each user`.
We will try `accounting_group_user` if it's possible to control tasks submitted by the same user account.
Thank you so much!
Best,Seung-Jin
On Wed, Oct 23, 2024, 1:54âPM Jaime Frey via HTCondor-users <htcondor-users@xxxxxxxxxxx> wrote:
Do you want to limit the number of jobs submitted to HTCondor for each user, or how many jobs HTCondor will run at a time for each user? You can limit the number of jobs that can be submitted, but additional submission attempts for the user will fail, which may cause Cromwell to think HTCondor is broken._______________________________________________
HTCondor has several mechanisms to control how many of the computing resources can be used by each user, regardless of how many jobs each has submitted. Thus, you can allow Cromwell to submit as many jobs as it wants and ensure one user doesnât monopolize the glideins in SLURM.If all of the jobs are submitted to HTCondor under the same user account, then you can set accounting_group_user in the HTCondor submit description file. This changes the identifier used for scheduling and accounting purposes.
The details of how HTCondor schedules jobs can be found here: https://htcondor.readthedocs.io/en/latest/admin-manual/cm-configuration.html#configuration-and-operation-of-the-negotiator
In brief, HTCondor attempts to ensure each user gets a âfair shareâ of the compute resources currently available. Jobs are not run in a strict FIFO order. You can configure many of the details of how the resources are divided amongst the users, including giving some users a larger share and setting a max amount that each user can use at a time.
- Jaime
On Oct 22, 2024, at 3:34âPM, Seung-Jin Sul <ssul@xxxxxxx> wrote:
Hi,
We are using Cromwell as a workflow engine and HTCondor as a backend. We have tried to throttle the number of jobs submitted to HTCondor from the Cromwell level using HogGroup and HogFactor but it's not working for use as intended.
The compute resource for our HTCondor is configured as a glide-in with SLURM. Thus, our HTCondor is run by a single-user account. So, we're seeking to pass the user's account name with the submission and then control the number of submissions from the HTCondor scheduler side. Can we limit the number of submissions per user from HTCondor?
Thank you!Seung Sul
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/
_______________________________________________ HTCondor-users mailing list To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a subject: Unsubscribe You can also unsubscribe by visiting https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users The archives can be found at: https://lists.cs.wisc.edu/archive/htcondor-users/
-- Tim Theisen (he, him, his) Release Manager HTCondor & Open Science Grid Center for High Throughput Computing Department of Computer Sciences University of Wisconsin - Madison 4261 Computer Sciences and Statistics 1210 W Dayton St Madison, WI 53706-1685 +1 608 265 5736