[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] Prioritizing certain jobs on a subset of worker nodes



Hello.

Is there a Condor "best practice" to control the share of resources certain jobs get of a subset of a pool's worker nodes? The only solution I can think of involves those worker nodes randomly choosing a RANK expression to prefer certain jobs over others. I wonder if there is something more elegant or centralized.
Here's the context: One of our pools consists of short-lived glide-in 
worker nodes from a number of different institutions/sites (identifiable 
by their "Site" attribute). Jobs in the pool belong to one of several 
classes (again, based on a custom attribute, say, "Class").
We need to control the share of resources that jobs of certain classes 
get on worker nodes at certain sites. For example, assuming sufficient 
demand, jobs from Class-A should get 70% of workers/slots at Site-1. The 
remaining Site-1 resources should be split such that Class-A jobs get 
twice the resources of Class-B.
I am thinking of implementing this using randomized rank expressions, 
but even with only 3 groups, it gets pretty messy, so I wonder if people 
have ideas on how to do this more cleanly.

Thanks very much,

Vlad