[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] condor_userprio with hierarchical group quotas wrong



Hi TJ,

indeed - who knew :)

This solves my problem vs. the users if I find a way to default the condor_userprio cmd to one of the negotiators - do I need to symlink the binary or is  there a knob for that ?

Still the listing without a specific negotiator is messed up, here is the difference

messed up:

[root@bird-htc-master21 ~]# condor_userprio -most
Last Priority Update: 12/2  08:14
Group                   Config     Use    Effective   Priority  Wghted Total Usage  Time Since  Weighted  Submitter
  User Name              Quota   Surplus   Priority    Factor   In Use (wghted-hrs) Last Usage Requested   Ceiling
---------------------- --------- ------- ------------ --------- ------ ------------ ---------- ---------- ---------
<snip>
BIRD_ilc.lite            1548.39 ByQuota                1000.00      0      1657.27    0+12:12          1          
  chbeyer@xxxxxxx                              636.50   1000.00      3       166.66    0+00:00                     
<snip

Correct

[root@bird-htc-master21 ~]# condor_userprio -most -name bird-htc-master21.desy.de
Last Priority Update: 12/2  08:14
Group                  Config     Use    Effective   Priority  Wghted Total Usage  Time Since  Weighted  Submitter
  User Name             Quota   Surplus   Priority    Factor   In Use (wghted-hrs) Last Usage Requested   Ceiling
--------------------- --------- ------- ------------ --------- ------ ------------ ---------- ---------- ---------
<snip>
BIRD_it.bide            7741.94 no                     1000.00      3     51271.85      <now>         83          
  chbeyer@xxxxxxx                             636.50   1000.00      3       166.66      <now>                     
BIRD_it.lite            7741.94 ByQuota                1000.00     46      9438.26      <now>         34          
<snip>
  chbeyer@xxxxxxx                           17134.28   1000.00     28      4444.85      <now>                     
<snip>

The 2nd negotiator just have one entry:

[root@bird-htc-master21 ~]# condor_userprio -most -name gpu_negotiator@xxxxxxxxxxxxxxxxxxxxxxxxx
Last Priority Update: 12/2  08:23
Group                  Config     Use    Effective   Priority  Wghted Total Usage  Time Since  Weighted  Submitter
  User Name             Quota   Surplus   Priority    Factor   In Use (wghted-hrs) Last Usage Requested   Ceiling
--------------------- --------- ------- ------------ --------- ------ ------------ ---------- ---------- ---------
BIRD_cms.bide           3870.97 no                     1000.00      1     82789.17      <now>       1021          
  user1@xxxxxxx                            1213.19   1000.00      1      5044.05      <now>                     
BIRD_jupyter.bide        120.00 no                     1000.00      1      4552.27      <now>          0          
--------------------- --------- ------- ------------ --------- ------ ------------ ---------- ---------- ---------
Number of users: 1              ByQuota                             1      5044.05    0+23:59                     


--
Christoph Beyer
DESY Hamburg
IT-Department

Notkestr. 85
Building 02b, Room 009
22607 Hamburg

phone:+49-(0)40-8998-2317
mail: christoph.beyer@xxxxxxx


Von: "John M Knoeller via HTCondor-users" <htcondor-users@xxxxxxxxxxx>
An: "htcondor-users" <htcondor-users@xxxxxxxxxxx>
CC: "John M Knoeller" <johnkn@xxxxxxxxxxx>
Gesendet: Freitag, 29. November 2024 19:46:05
Betreff: condor_userprio with hierarchical group quotas wrong

Are you running two negotiators? 

try running

condor_userprio -af Name Priority NegotiatorName

I would expect to see two records with the same Name to have different values for NegotiatorName.

-tj


From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Beyer, Christoph <christoph.beyer@xxxxxxx>
Sent: Thursday, November 28, 2024 6:41 AM
To: htcondor-users <htcondor-users@xxxxxxxxxxx>
Subject: [HTCondor-users] condor_userprio with hierarchical group quotas wrong
 

Hi,

the listing (at least) is broken with condor_userprio, also see below, it does not seem right that there are to quotas for one accountinggroup ?

condor_userprio -autoformat Name priority  | grep chbeyer
BIRD_it.lite.chbeyer@xxxxxxx 500.0
BIRD_it.lite.chbeyer@xxxxxxx 14431.029
BIRD_it.bide.chbeyer@xxxxxxx 1315.961

condor_userprio -most gives:

BIRD_ilc.bide             774.19 no                     1000.00      0       117.65    0+01:15          0         
  chbeyer@xxxxxxx                             1302.30   1000.00     73       153.51    0+00:00                    
  userxy@xxxxxxx                             3975.63   1000.00     18      2425.64    0+00:00                    
  punch001@xxxxxxx                            4093.79   1000.00      8       548.12    0+00:00                    
  chbeyer@xxxxxxx                            14423.98   1000.00     47      2693.30    0+00:00                    
BIRD_cms.bide            3870.97 no                     1000.00      1     82641.47      <now>       2419         
BIRD_atlas.bide          2903.23 no                     1000.00      9     31963.87    0+00:00         25         
BIRD_jupyter.bide         120.00 no                     1000.00      1      4432.11      <now>          0         
BIRD_it.bide             7741.94 no                     1000.00     73     51258.69    0+00:00         73         
BIRD_it.lite             7741.94 ByQuota                1000.00     73      5709.75    0+00:00         73         

chbeyer jobs should be splitted between BIRD_it.bide & BIRD_it.lite !

Is there any master file that I can query for legit information about THE priority ?

Few users do look into it but those get upset because they often show up in quotas that they do not belong to and then they tend to blame all kind of problems on that 'fact' :(

This is on 24.0.1 but I recognized the problem also in earlier versions for a while ...

Best
christoph


--
Christoph Beyer
DESY Hamburg
IT-Department

Notkestr. 85
Building 02b, Room 009
22607 Hamburg

phone:+49-(0)40-8998-2317
mail: christoph.beyer@xxxxxxx
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe

The archives can be found at: https://www-auth.cs.wisc.edu/lists/htcondor-users/

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe

The archives can be found at: https://www-auth.cs.wisc.edu/lists/htcondor-users/