Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] Using more available nodes - User priorities?
- Date: Wed, 12 Jul 2006 16:27:40 +1000
- From: "DeVoil, Peter" <Peter.DeVoil@xxxxxxxxxxxxxx>
- Subject: Re: [Condor-users] Using more available nodes - User priorities?
Greg,
We have similar problems. (on 6.6.11/XP)
I have a user who continually generates "nice-user" jobs - he has a script that pops more jobs in the queue when it notices the queue nearing empty. After a while (~5 days?), his pool utilisation (number of machines running jobs for him) drops to ~50% - the balance are idle.
I have resorted to stopping the master twice weekly, and manually clearing all the accounting states (rm ~condor/spool/Accountantnew.log). Could be math under/overflow?
Yours,
pdev.
________________________________
From: condor-users-bounces@xxxxxxxxxxx [mailto:condor-users-bounces@xxxxxxxxxxx] On Behalf Of Greg.Hitchen@xxxxxxxx
Sent: Wednesday, 12 July 2006 1:15 PM
To: condor-users@xxxxxxxxxxx
Subject: [Condor-users] Using more available nodes - User priorities?
We have a user running ~120 jobs per night. At the moment no other users are submitting jobs.
We have a total of ~200 execute nodes available. He gets a max of ~70-80 jobs running at once.
i.e. there are still ~120 nodes available but not getting used. Would increasing his priority get him more machines. From reading the docs I have a feel for how this works when multiple users are submitting jobs and competing for resources but how does this work when there is only one user?
Is there some sort of limit to one user only being able to use a certain fraction of available nodes?
i.e. Are some "reserved" in case other users submit jobs? Would increasing his priority get him more nodes if he is the only user?
BTW these couple of hundred nodes are in 3 different pools with flocking enabled.
Thanks.
Cheers
Greg
-----------------------------------------------------------------------
Greg Hitchen greg.hitchen@xxxxxxxx
CSIRO Exploration and Mining phone:ᄉ 8 6436 8663
Australian Resources Research Centre (ARRC) fax: ᄉ 8 6436 8555
Postal address: mob: 0407 952 748
PO Box 1130, Bentley WA 6102, Australia Street Address:
26 Dick Perry Avenue, Kensington WA 6151
-----------------------------------------------------------------------
********************************DISCLAIMER****************************
The information contained in the above e-mail message or messages
(which includes any attachments) is confidential and may be legally
privileged. It is intended only for the use of the person or entity
to which it is addressed. If you are not the addressee any form of
disclosure, copying, modification, distribution or any action taken
or omitted in reliance on the information is unauthorised. Opinions
contained in the message(s) do not necessarily reflect the opinions
of the Queensland Government and its authorities. If you received
this communication in error, please notify the sender immediately and
delete it from your computer system network.