Re: [HTCondor-users] how to ignore some cores

[Mary Romelfanger <mary@xxxxxxxxx>]

Another approach:

RESERVED_CORES = 2

SLOT_TYPE_1 = cpus=1,ram=2010
NUM_SLOTS_TYPE_1 = ($(DETECTED_CORES)-$(RESERVED_CORES))

This is my most simple example.  
RESERVED_CORES is NOT an existing knob (Maybe it should be ( ).  I added it to match RESERVED_MEMORY which I also use in another instance.  It allows me to pull out some cores on machines that have non HTCondor jobs running as well.

But this does the same as below and allows me to equalize the per core memory allocation across mixed sized machines.

I use this approach because on some machines I also define a specific number of cores with a larger amount of memory so that I can control the number of those specific job types that require more memory on each node.    Here is a more complex example.

RESERVED_CORES = 2
RESERVED_MEMORY = 4096

SLOT_TYPE_1 = cpus=1,ram=8192
NUM_SLOTS_TYPE_1 = 6

SLOT_TYPE_2 = cpus=1,ram=12288
NUM_SLOTS_TYPE_2 = 2

SLOT_TYPE_3 = cpus=1,ram=auto
NUM_SLOTS_TYPE_3 = ($(DETECTED_CORES)-$(NUM_SLOTS_TYPE_1)-$(NUM_SLOTS_TYPE_2)-$(RESERVED_CORES))

     With this setup I have a lot of control of memory, slots, and memory per slot.

          Mary

Mary Romelfanger
Deputy Branch Manager OED/DSB
Space Telescope Science Institute
mary@xxxxxxxxx

ïOn 5/18/18, 3:49 PM, "HTCondor-users on behalf of Carlos Adean" <htcondor-users-bounces@xxxxxxxxxxx on behalf of carlosadean@xxxxxxxxxxxx> wrote:

    It's so simple!
    
    Many thanks!
    
    --
    Carlos Adean
    IT Team
    linea.gov.br
    skype: carlosadean
    
    ----- Mensagem original -----
    De: "John M Knoeller" <johnkn@xxxxxxxxxxx>
    Para: "HTCondor-Users Mail List" <htcondor-users@xxxxxxxxxxx>
    Enviadas: Sexta-feira, 18 de maio de 2018 15:45:23
    Assunto: Re: [HTCondor-users] how to ignore some cores
    
    You could force NUM_CPUS to be any value you want, including an expression.
    
    MEMORY_PER_CORE = 2040
    NUM_CPUS = int(ceil($(DETECTED_MEMORY) / $(MEMORY_PER_CORE)))
    
    -tj
    
    -----Original Message-----
    From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf Of Carlos Adean
    Sent: Friday, May 18, 2018 12:18 PM
    To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
    Subject: [HTCondor-users] how to ignore some cores
    
    Hi list,
    
    Due hardware problems some execution nodes are showing less memory then others, consequently its slots have less memory.
    
    Is possible to configure htcondor so I can keep the slots with the same amount of memory, maybe ignoring some cores in those machines ?
    
    
    Slots are configured dynamically (total memory / N_cores = 1 slot)
    
    
    
    Thanks,
    
    --
    Carlos Adean
    IT Team
    linea.gov.br
    skype: carlosadean
    
    _______________________________________________
    HTCondor-users mailing list
    To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
    subject: Unsubscribe
    You can also unsubscribe by visiting
    https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
    
    The archives can be found at:
    https://lists.cs.wisc.edu/archive/htcondor-users/
    
    _______________________________________________
    HTCondor-users mailing list
    To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
    subject: Unsubscribe
    You can also unsubscribe by visiting
    https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
    
    The archives can be found at:
    https://lists.cs.wisc.edu/archive/htcondor-users/
    _______________________________________________
    HTCondor-users mailing list
    To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
    subject: Unsubscribe
    You can also unsubscribe by visiting
    https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
    
    The archives can be found at:
    https://lists.cs.wisc.edu/archive/htcondor-users/