Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] Grid with SMP hosts having limited custom hardware
- Date: Tue, 17 Nov 2009 21:50:00 -0500
- From: Matthew Farrellee <matt@xxxxxxxxxx>
- Subject: Re: [Condor-users] Grid with SMP hosts having limited custom hardware
Eric Stadtherr wrote:
> Hi,
>
> We are building a Condor-managed grid comprised of a number of
> eight-core servers. Some of these servers have a pair of custom hardware
> inputs that are utilized by some of the processing jobs. We'd like the
> Condor scheduler to be able to allocate jobs to slots in a way that
> doesn't oversubscribe the hardware inputs.
>
> We've looked at some possible solutions but none seem to work:
>
> 1. The ConcurrencyLimit capability appears to be a grid-wide limit,
> and not something enforced per-host
> 2. We can't dedicate slots to the hardware inputs, since some jobs
> make use of both inputs (and would naturally only occupy one
> slot)
> 3. The SMP-specific shared resource limits seem to only address
> memory and disk constraints
> 4. The "START" expression does not have access to job information
> from other slots on the same host
>
>
> Is there a way to make this work?
>
> Thanks!
(4) isn't true. A slot can make decisions based on the state of its siblings.
http://condor-wiki.cs.wisc.edu/index.cgi/wiki?p=HowToAllowSomeJobs
Best,
matt