Re: [HTCondor-users] Multiple negotiator's

[Dudu Handelman <duduhandelman@xxxxxxxxxxx>]

Thanks Thomas. 

Yes, those jobs are from different users but many jobs are similar (same autocluster). 

Thats brilliant idea. if I understand correctly some jobs will run without negotiation. 

Will read more about it. 

Thanks 

David 

Get Outlook for Android

---

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Thomas Hartmann <thomas.hartmann@xxxxxxx>
Sent: Tuesday, August 16, 2022, 21:45
To: htcondor-users@xxxxxxxxxxx <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] Multiple negotiator's

Hi David,

are these jobs all from different users or similar to each other? Maybe
you can extend the claims from the schedd on startd slots.

Cheers,
 Thomas

On 16/08/2022 18.19, Dudu Handelman wrote:
> Christoph. 
> Im currently using pslots.  
> Will it be a lot faster with regular slots? 
>
> Thanks 
> David 
>
> Get Outlook for Android <https://aka.ms/AAb9ysg>
>
> ------------------------------------------------------------------------
> *From:* HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of
> Dudu Handelman <duduhandelman@xxxxxxxxxxx>
> *Sent:* Tuesday, August 16, 2022, 18:24
> *To:* HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
> *Subject:* Re: [HTCondor-users] Multiple negotiator's
>
> Thanks Christoph. 
> It's 10k nodes and about 30% of the job's are maximum 5 minutes of runtime.
>
> It will be fun to deal with this challenge. 
>
> Thanks David 
> Get Outlook for Android <https://aka.ms/AAb9ysg>
>
> ------------------------------------------------------------------------
> *From:* HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of
> Beyer, Christoph <christoph.beyer@xxxxxxx>
> *Sent:* Tuesday, August 16, 2022, 18:18
> *To:* HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
> *Subject:* Re: [HTCondor-users] Multiple negotiator's
>
> Hi,
>
> by 10k you mean cores or nodes ?
>
> The negotiation cycle depends not so much on the nodes also keep in mind
> only free slots get negotiated.
>
> You can tag slots to be negotiated by certain negotiators and exclude
> certain slots from being negotiated by others etc. but that kind of
> divides your pool in logic parts which is not so much the idea of a pool
> in the first place so to speak ;)
>
> Best
> christoph
>
>
> --
> Christoph Beyer
> DESY Hamburg
> IT-Department
>
> Notkestr. 85
> Building 02b, Room 009
> 22607 Hamburg
>
> phone:+49-(0)40-8998-2317
> mail: christoph.beyer@xxxxxxx
>
> ------------------------------------------------------------------------
> *Von: *"Dudu Handelman" <duduhandelman@xxxxxxxxxxx>
> *An: *"htcondor-users" <htcondor-users@xxxxxxxxxxx>
> *Gesendet: *Dienstag, 16. August 2022 17:01:26
> *Betreff: *Re: [HTCondor-users] Multiple negotiator's
>
> Hi again. 
> Let me ask it differently.  I'm planning 10k executers pool. I assume
> that a single negotiator will have a long cycle. 
>
> What are my options? 
>
> Thanks, in advance
> David 
>
> Get Outlook for Android <https://aka.ms/AAb9ysg>
>
> ------------------------------------------------------------------------
> *From:* Dudu Handelman <duduhandelman@xxxxxxxxxxx>
> *Sent:* Monday, August 15, 2022, 11:53
> *To:* htcondor-users@xxxxxxxxxxx <htcondor-users@xxxxxxxxxxx>
> *Subject:* Multiple negotiator's
>
> Hi All,
> I would like to reduce the matching cycle (basically it's a large pool).
> I found an old wiki page that describe how to accomplish that. Is it
> really possible?
>
> Thanks
> David
>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/
>
>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/