[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[HTCondor-users] Prioritizing certain jobs on a subset of worker nodes
- Date: Mon, 03 Apr 2017 12:02:14 -0500
- From: Vladimir Brik <vladimir.brik@xxxxxxxxxxxxxxxx>
- Subject: [HTCondor-users] Prioritizing certain jobs on a subset of worker nodes
Hello.
Is there a Condor "best practice" to control the share of resources
certain jobs get of a subset of a pool's worker nodes? The only solution
I can think of involves those worker nodes randomly choosing a RANK
expression to prefer certain jobs over others. I wonder if there is
something more elegant or centralized.
Here's the context: One of our pools consists of short-lived glide-in
worker nodes from a number of different institutions/sites (identifiable
by their "Site" attribute). Jobs in the pool belong to one of several
classes (again, based on a custom attribute, say, "Class").
We need to control the share of resources that jobs of certain classes
get on worker nodes at certain sites. For example, assuming sufficient
demand, jobs from Class-A should get 70% of workers/slots at Site-1. The
remaining Site-1 resources should be split such that Class-A jobs get
twice the resources of Class-B.
I am thinking of implementing this using randomized rank expressions,
but even with only 3 groups, it gets pretty messy, so I wonder if people
have ideas on how to do this more cleanly.
Thanks very much,
Vlad