[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Trying to understand quotas and especially hierarchical groups



Hi Thomas, 

Thanks for your mail.  I am curious why your second command generates a doubling of each group.

Itâs as you said, group_atlas usage is very close to the sum of usages of group_atlas.prod and group_atlas.anal. 

Itâs as if the groups form a hierarchy for the purpose of tracking usage, but thatâs it - in all other senses they are not hierarchical, so they are not defined as a hierarchy nor are they displayed as a hierarchy - users are displayed under their immediate subgroup if there is one, but at a level that is the same as if they were a top-level group.  There is no nesting of subgroups under the parent group, as would be expected in a true hierarchy.

Iâve pretty much decided to ditch the subgroup hierarchy, as ATLAS is the only case we have that needs it, and I can also deal with this by using a different PRIORITY_FACTOR for the pilots as for production.

The other option was to see if I could modify condor_userprio to do the right thing, I donât think I could find enough time to do that though.  But maybe someone else will chime in with the answer!

JT


> On 19 Nov 2025, at 12:48, Thomas Hartmann <thomas.hartmann@xxxxxxx> wrote:
> 
> Hi Jeff,
> 
> can you try the command with the subgroups configured?
> 
> As I understand it, it should give you the quotas for the groups including the subgroups integrated. I would assume/hope, that with the subgroups this should also reflect more or less the configured quota weights (provided all groups are somewhat active).
> 
> For our grid cluster it looks like [1], where AFAIS -grouprollup looks reasonable, while with the -hierarchical flag the users in the group seem to be mashed together (in parallel?) to the general group view
> 
> Cheers,
>  Thomas
> 
> [1]
> >  condor_userprio -grouprollup -quota
> Last Priority Update: 11/19 12:44
> Group                    Effective  Config     Use    Subtree   Weighted
> Name                       Quota     Quota   Surplus   Quota   Requested
> ------------------------ --------- --------- ------- --------- ----------
> <none>                        0.00      0.00 yes      20031.00          0
> group_ATLAS                   0.00      0.00 no           0.00       9307
> group_BELLE2               2121.93      0.25 ByQuota   2121.93       1507
> group_CMS                     0.00      0.00 no           0.00      10560
> group_DESY                 6790.17      0.80 ByQuota   6790.17          0
> group_LHCB                 1527.79      0.18 no        1527.79         38
> group_OPS                  7638.94      0.90 ByQuota   7638.94          2
> ------------------------ --------- --------- ------- --------- ----------
> 
> 
> > condor_userprio -hierarchical -quota
> Last Priority Update: 11/19 12:44
> Group                    Effective  Config     Use    Subtree   Weighted
> Name                       Quota     Quota   Surplus   Quota   Requested
> ------------------------ --------- --------- ------- --------- ----------
> group_ATLAS                   0.00      0.00 no           0.00       9330
> group_ATLAS                2682.86      0.45 ByQuota   2682.86       9330
> group_BELLE2               1490.48      0.25 ByQuota   1490.48       1516
> group_BELLE2               2122.03      0.25 ByQuota   2122.03       1516
> group_CMS                     0.00      0.00 no           0.00      10560
> group_CMS                  3279.05      0.55 ByQuota   3279.05      10560
> group_DESY                 4769.52      0.80 ByQuota   4769.52          0
> group_DESY                 6790.51      0.80 ByQuota   6790.51          0
> group_LHCB                 1527.86      0.18 no        1527.86         38
> group_LHCB                 1073.14      0.18 no        1073.14         38
> group_OPS                  5365.71      0.90 ByQuota   5365.71          1
> group_OPS                  7639.32      0.90 ByQuota   7639.32          1
> ------------------------ --------- --------- ------- --------- ----------