Re: [HTCondor-users] Group memory quota

[Todd Tannenbaum <tannenba@xxxxxxxxxxx>]

On 12/13/2018 12:48 PM, David Cohen wrote:
> Thanks Tom,
> But I'm looking for a hard quota that will cap a group the same way it 
> is done for CPU:
> GROUP_QUOTA_group_somegrp = 500
> 

Hi David,

The unit of measure for the GROUP_QUOTA_xxx is in SLOT_WEIGHT.  So the 
"500" above refers to 500 cpu cores if you use the default value for 
SLOT_WEIGHT, but you can change it to take Memory into account as well 
as Tom shows below.  Heck, you could even define SLOT_WEIGHT solely in 
terms of Memory and ignore CPU cores if Memory is all you really care 
about for scheduling...

regards,
Todd

> 
> David
> 
> On Thu, Dec 13, 2018 at 7:59 PM Tom Downes <downes@xxxxxxx 
> <mailto:downes@xxxxxxx>> wrote:
> 
>     David:____
> 
>     __ __
> 
>     My approach to this is to use SlotWeight to assign each slot a
>     weight that is equal to the greater of CPUs or CPUs*<average RAM per
>     core>. For me that # is 2GB.____
> 
>     __ __
> 
>     SLOT_WEIGHT = ifThenElse(Cpus >= Memory/2048, Cpus, Memory/2048)____
> 
>     __ __
> 
>     You might be able to substitute a Machine ClassAd for 2048 if you
>     have a non-uniform RAM/core ratio.____
> 
>     ____
> 
>     User priorities and queue order then end up looking reasonable,
>     though you canât help the fact that someone using up all the RAM on
>     a node is still blocking use of idle CPUs on that node.____
> 
>     ____
> 
>     Tom____
> 
>     __ __
> 
>     *From: *HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx
>     <mailto:htcondor-users-bounces@xxxxxxxxxxx>> on behalf of David
>     Cohen <cdavid@xxxxxxxxxxxxxxxxxxxxxx
>     <mailto:cdavid@xxxxxxxxxxxxxxxxxxxxxx>>
>     *Reply-To: *HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx
>     <mailto:htcondor-users@xxxxxxxxxxx>>
>     *Date: *Thursday, December 13, 2018 at 11:44 AM
>     *To: *"htcondor-users@xxxxxxxxxxx
>     <mailto:htcondor-users@xxxxxxxxxxx>" <htcondor-users@xxxxxxxxxxx
>     <mailto:htcondor-users@xxxxxxxxxxx>>
>     *Subject: *[HTCondor-users] Group memory quota____
> 
>     __ __
> 
>     Hi,____
> 
>     Is there a group memory quota?____
> 
>     I went through the documentation trying to find a way to prevent a
>     group from taking hold of all the cluster memory and practically
>     denying the use of free CPU by others.____
> 
>     __ __
> 
>     __ __
> 
>     Cheers,____
> 
>      ÂÂÂÂ David____
> 
>     _______________________________________________
>     HTCondor-users mailing list
>     To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx
>     <mailto:htcondor-users-request@xxxxxxxxxxx> with a
>     subject: Unsubscribe
>     You can also unsubscribe by visiting
>     https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> 
>     The archives can be found at:
>     https://lists.cs.wisc.edu/archive/htcondor-users/
> 
> 
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/
> 


-- 
Todd Tannenbaum <tannenba@xxxxxxxxxxx> University of Wisconsin-Madison
Center for High Throughput Computing   Department of Computer Sciences
HTCondor Technical Lead                1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132                  Madison, WI 53706-1685