Re: [Condor-users] Max Number of Jobs Submission

["David A. Kotz" <dkotz@xxxxxxxxxxxxx>]

Natarajan, Senthil wrote:
> Hi,
> Thanks for the info.
> Here Central manager is the only dedicated submit node. And also runs
> job.
>
> Suppose if I configure
> MAX_JOBS_RUNNING        = 500
>
> It means maximum of 500 jobs can run at any time, but more than 500 jobs
> say 2000 jobs can submit to the pool using condor_submit right?

That is correct.  You can have 500 jobs running and 50000 in the queue 
waiting.


> Job varies from running less than a minute to 30 minutes and with the
> data files around 1 mb.
>
> Is there any way to specify maximum jobs submission at the user level,
> for example each user can submit max of 100 jobs?

You can do something like that by defining each user as a group and 
implementing group quotas, as described here:

http://www.cs.wisc.edu/condor/manual/v6.8/3_4User_Priorities.html#SECTION00447000000000000000


... but the normal behavior of Condor is to try to share machines 
fairly.  As a user uses more resources, his/her priority worsens, and 
jobs from other users can preempt his/hers.  This default behavior is 
described here:

http://www.cs.wisc.edu/condor/manual/v6.8/3_4User_Priorities.html


> Thanks,
> Senthil
>
>
>
>
> -----Original Message-----
> From: condor-users-bounces@xxxxxxxxxxx
> [mailto:condor-users-bounces@xxxxxxxxxxx] On Behalf Of David A. Kotz
> Sent: Thursday, March 22, 2007 12:10 PM
> To: Condor-Users Mail List
> Subject: Re: [Condor-users] Max Number of Jobs Submission
>
> Without knowing exactly what your jobs are doing, it's hard to tell you 
> exactly, but that central manager, even if it is also the submit node, 
> should be able to handle more jobs than your cluster can run.  I allow 
> each of my desktops (I don't have a single submit node) to run 150 jobs,
>
> and I have some dedicated submit nodes with limits of 200 and 500.
>
> The condor_config line below controls the number of running jobs from a 
> single submit node:
>
>
> ##  What's the maximum number of jobs you want a single submit machine
> ##  to spawn shadows for?
> MAX_JOBS_RUNNING        = 150
>
>
>
> Natarajan, Senthil wrote:
> > Hi,
> >
> > What is the maximum number of jobs can be submitted at any given time,
>
> > (i.e) what is the max number of jobs can be queued ?
> >
> > How to calculate this?
> >
> >  
> >
> > Our Condor pool (condor 6.8.4) central manager is running on RHEL 4.0.
> >
> > It is a Double dual core Xeon processor (total 8 CPU) of 2.8 GHz and 8
>
> > GB Memory.
> >
> > And pool has around 150 nodes.
> >
> >  
> >
> > Is there any way to set the limit for the max jobs, in order to avoid 
> > the crash?
> >
> >  
> >
> > Thanks,
> >
> > Senthil
> >
> >  
> >
> >  
> >
> > .
> >
> >  
> >
> >  
> ------------------------------------------------------------------------
> > _______________________________________________
> > Condor-users mailing list
> > To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx
> with a
> > subject: Unsubscribe
> > You can also unsubscribe by visiting
> > https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> >
> > The archives can be found at either
> > https://lists.cs.wisc.edu/archive/condor-users/
> > http://www.opencondor.org/spaces/viewmailarchive.action?key=CONDOR
>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
> a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at either
> https://lists.cs.wisc.edu/archive/condor-users/
> http://www.opencondor.org/spaces/viewmailarchive.action?key=CONDOR
>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at either
> https://lists.cs.wisc.edu/archive/condor-users/
> http://www.opencondor.org/spaces/viewmailarchive.action?key=CONDOR