Re: [HTCondor-users] Multiple negotiator's

[Dudu Handelman <duduhandelman@xxxxxxxxxxx>]

Thanks Christoph. 

It's 10k nodes and about 30% of the job's are maximum 5 minutes of runtime.

It will be fun to deal with this challenge. 

Thanks David 

Get Outlook for Android

---

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Beyer, Christoph <christoph.beyer@xxxxxxx>
Sent: Tuesday, August 16, 2022, 18:18
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] Multiple negotiator's

Hi,

by 10k you mean cores or nodes ?

The negotiation cycle depends not so much on the nodes also keep in mind only free slots get negotiated.

You can tag slots to be negotiated by certain negotiators and exclude certain slots from being negotiated by others etc. but that kind of divides your pool in logic parts which is not so much the idea of a pool in the first place so to speak ;)

Best

christoph

--
Christoph Beyer
DESY Hamburg
IT-Department

Notkestr. 85
Building 02b, Room 009
22607 Hamburg

phone:+49-(0)40-8998-2317
mail: christoph.beyer@xxxxxxx

---

Von: "Dudu Handelman" <duduhandelman@xxxxxxxxxxx>
An: "htcondor-users" <htcondor-users@xxxxxxxxxxx>
Gesendet: Dienstag, 16. August 2022 17:01:26
Betreff: Re: [HTCondor-users] Multiple negotiator's

Hi again. 

Let me ask it differently.  I'm planning 10k executers pool. I assume that a single negotiator will have a long cycle. 

What are my options? 

Thanks, in advance

David 

Get Outlook for Android

---

From: Dudu Handelman <duduhandelman@xxxxxxxxxxx>
Sent: Monday, August 15, 2022, 11:53
To: htcondor-users@xxxxxxxxxxx <htcondor-users@xxxxxxxxxxx>
Subject: Multiple negotiator's

Hi All,

I would like to reduce the matching cycle (basically it's a large pool).

I found an old wiki page that describe how to accomplish that. Is it really possible?

Thanks

David

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/