Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] Trying to understand quotas and especially hierarchical groups
- Date: Wed, 19 Nov 2025 12:56:56 +0100
- From: Jeff Templon <templon@xxxxxxxxx>
- Subject: Re: [HTCondor-users] Trying to understand quotas and especially hierarchical groups
Hi Thomas,
Thanks for your mail. I am curious why your second command generates a doubling of each group.
Itâs as you said, group_atlas usage is very close to the sum of usages of group_atlas.prod and group_atlas.anal.
Itâs as if the groups form a hierarchy for the purpose of tracking usage, but thatâs it - in all other senses they are not hierarchical, so they are not defined as a hierarchy nor are they displayed as a hierarchy - users are displayed under their immediate subgroup if there is one, but at a level that is the same as if they were a top-level group. There is no nesting of subgroups under the parent group, as would be expected in a true hierarchy.
Iâve pretty much decided to ditch the subgroup hierarchy, as ATLAS is the only case we have that needs it, and I can also deal with this by using a different PRIORITY_FACTOR for the pilots as for production.
The other option was to see if I could modify condor_userprio to do the right thing, I donât think I could find enough time to do that though. But maybe someone else will chime in with the answer!
JT
> On 19 Nov 2025, at 12:48, Thomas Hartmann <thomas.hartmann@xxxxxxx> wrote:
>
> Hi Jeff,
>
> can you try the command with the subgroups configured?
>
> As I understand it, it should give you the quotas for the groups including the subgroups integrated. I would assume/hope, that with the subgroups this should also reflect more or less the configured quota weights (provided all groups are somewhat active).
>
> For our grid cluster it looks like [1], where AFAIS -grouprollup looks reasonable, while with the -hierarchical flag the users in the group seem to be mashed together (in parallel?) to the general group view
>
> Cheers,
> Thomas
>
> [1]
> > condor_userprio -grouprollup -quota
> Last Priority Update: 11/19 12:44
> Group Effective Config Use Subtree Weighted
> Name Quota Quota Surplus Quota Requested
> ------------------------ --------- --------- ------- --------- ----------
> <none> 0.00 0.00 yes 20031.00 0
> group_ATLAS 0.00 0.00 no 0.00 9307
> group_BELLE2 2121.93 0.25 ByQuota 2121.93 1507
> group_CMS 0.00 0.00 no 0.00 10560
> group_DESY 6790.17 0.80 ByQuota 6790.17 0
> group_LHCB 1527.79 0.18 no 1527.79 38
> group_OPS 7638.94 0.90 ByQuota 7638.94 2
> ------------------------ --------- --------- ------- --------- ----------
>
>
> > condor_userprio -hierarchical -quota
> Last Priority Update: 11/19 12:44
> Group Effective Config Use Subtree Weighted
> Name Quota Quota Surplus Quota Requested
> ------------------------ --------- --------- ------- --------- ----------
> group_ATLAS 0.00 0.00 no 0.00 9330
> group_ATLAS 2682.86 0.45 ByQuota 2682.86 9330
> group_BELLE2 1490.48 0.25 ByQuota 1490.48 1516
> group_BELLE2 2122.03 0.25 ByQuota 2122.03 1516
> group_CMS 0.00 0.00 no 0.00 10560
> group_CMS 3279.05 0.55 ByQuota 3279.05 10560
> group_DESY 4769.52 0.80 ByQuota 4769.52 0
> group_DESY 6790.51 0.80 ByQuota 6790.51 0
> group_LHCB 1527.86 0.18 no 1527.86 38
> group_LHCB 1073.14 0.18 no 1073.14 38
> group_OPS 5365.71 0.90 ByQuota 5365.71 1
> group_OPS 7639.32 0.90 ByQuota 7639.32 1
> ------------------------ --------- --------- ------- --------- ----------