Re: [Condor-users] GCB Performance

["Chris Miles" <chrismiles@xxxxxxxxxxxxxxxx>]

I have done some testing with JOB_START_COUNT and have not seen any 
improvement.
I have tried values of 10, 20, 30, and 40. I currently have 40 VMs running 
for this experiment.

The job takes a minute to run on each machine through a shell.

JOB_START_COUNT = 10: 12m 23s
JOB_START_COUNT = 20: 12m 35s
JOB_START_COUNT = 30: 12m 20s
JOB_START_COUNT = 40: 11m 41s

So I am changing that value but im still seeing the same trend in 
performance when JOB_START_RUN
was at its default setting (1?)

Grepping the process list is showing 40 condor_shadows ??? - does this mean 
there is a job running on every VM then?
why is it still taking 12 mins to process.

my cpu and memory usage is still acceptable with that many shadows. 
condor_status is showing all machines Claimed + Busy as expected.

I have not touched the JOB_START_DELAY variable? But as default that means 
for example 40 jobs will execute.. it will wait 2 minutes
and then execute the last 10. And I would expect the overall processing time 
to be just a couple of minutes?

Chris

----- Original Message ----- 
From: "Se-Chang Son" <sschang@xxxxxxxxxxx>
To: "Condor-Users Mail List" <condor-users@xxxxxxxxxxx>
Sent: Thursday, January 19, 2006 5:32 PM
Subject: Re: [Condor-users] GCB Performance


> Chris Miles wrote:
> > Yeah I shall definately try those out tomorrow. Im not really bothered 
> > about
> > cpu or memory usage on the submitting
> > machine. Thats only running GT4 and Condor and acts as my middleware...
> > nothing else. I just want to get my jobs
> > submitting as fast as possible.
> >
> > Do you think it might be worth while tarballing the numerous output 
> > files?
> > would this help condor out a little?
>
> Condor uses one TCP connection to ship all output files back to the
> submit machine. Therefore, the performance gain will be proportional to
> the amount that you reduce the total bytes by tar+ziping.
> _______________________________________________
> Condor-users mailing list
> Condor-users@xxxxxxxxxxx
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users