Re: [Condor-users] How can I force clients to compute in a dedicated cluster?

[Dan Bradley <dan@xxxxxxxxxxxx>]

Turn off machine activity induced preemption/suspension in your condor 
configuration:

WANT_SUSPEND = FALSE
CONTINUE = TRUE
SUSPEND = FALSE
PREEMPT = FALSE

If you are doing any kind of large scale test (e.g. several 1000s or 
100000s of jobs in the queue), then the latest development version 
(6.9.5) is the best Condor version to use unless you want Condor to 
perform poorly ;-)  Although this is a development version, it is the 
feature-frozen version that will become the beginning of the next stable 
series near the end of this year, so it is a reasonable choice for 
comparison.

If you are running more than 200 jobs at a time from a single condor 
schedd, then you will need to configure MAX_JOBS_RUNNING to be higher 
than the default of 200.

If you do use a version of Condor from before 6.9.5 (or if you use a 
configuration file from before 6.9.5), then you will not see speeds of 
job startup greater than 1 job per 2 seconds, because the default 
configuration with prior versions of condor was JOB_START_DELAY = 2.  In 
6.9.5, the throttling of job startup rate has been moved to the file 
transfer stage (MAX_CONCURRENT_UPLOADS and MAX_CONCURRENT_DOWNLOADS), 
and I would expect the defaults to be sufficient for most purposes.

--Dan

Brad Goldsmith wrote:

> Hi All,
>
> I have a small cluster of nodes that I am using to do some comparative 
> testing between different distributed computing systems. Condor is one 
> of these that I am starting to do some testing with.
>
> What I'd like to do, to make things as fair as possible, is to force 
> all of the systems to compute pretty much as quickly as they can. WIth 
> condor, I have noticed that jobs seem to sit idle for some time before 
> being computed. I am guessing this is because I've been constantly 
> interrogating clients to see what's going on and this has tripped its 
> suspension policies. When I go for lunch and come back the work is 
> done :-)
>
> What is the best way to make a condor client grab whatever is 
> available and run at it at full steam?
>
> Thanks,
> Brad
>
>
>
> ---
>
>
> Brad Goldsmith
>
> School of Computing
>
> University of Tasmania, Tasmania, Australia
>
> Office: Launceston Campus, Computing Building, V-177
>
> Telephone: (03) 6324 3389 International: +61-3-6324 3389
>
> Facsimile: (03) 6324 3368 International: +61-3-6324 3368
>
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at: 
> https://lists.cs.wisc.edu/archive/condor-users/
>