[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] negotiator questions
From: Brian Bockelman <bbockelm@xxxxxxxxxxx>
Date: 03/07/2016 10:01 AM
> The schedd, however, is more sensitive to number
of queued jobs. Each
> takes up somewhere in the neighborhood of 50KB of RAM and a small
amount
> of CPU time (which becomes noticeable once there are tens of thousands
of
> idle jobs).
I can say from personal experience that there has
been massive improvement
in this respect in recent versions, from later 8.2
into 8.4. I've had
situations where there's been hundreds of thousands
of jobs queued in a
given scheduler, and the only real problem we ran
into was condor_q's
proclivity to list every last one of those jobs. Had
to bump up the the
condor_q's timeout value for a while before the improvements
came out.
-Michael Pelletier.