Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] Submission of large numbers of jobs
- Date: Wed, 11 Jul 2012 09:04:30 +0100
- From: Brian Candler <B.Candler@xxxxxxxxx>
- Subject: Re: [Condor-users] Submission of large numbers of jobs
On Wed, Jul 11, 2012 at 09:30:40AM +0200, Martin Kudlej wrote:
> >>From what I've read, each job will take ~10KB of RAM in schedd, so 100K jobs
> >would be about 1G of RAM just for the job queue. If I can afford that, is
> >there anything else to worry about?
> You can configure more than one scheduler.
> Also you should consider to do it on 64 bit arch. because of memory allocation by one daemon.
All machines are built as 64-bit anyway (some nodes have 96GB RAM)
For multiple schedulers, I found
http://www.cyclecomputing.com/wiki/index.php?title=Running_Multiple_Condor_Schedds
Thanks for the pointers!
Cheers,
Brian.