Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] process number to start higher than zero
- Date: Thu, 19 Aug 2010 07:01:38 -0400
- From: Matthew Farrellee <matt@xxxxxxxxxx>
- Subject: Re: [Condor-users] process number to start higher than zero
Something like?
cmd = /bin/cat
args = $([100 + $(Process)]).in
input = $([100 + $(Process)]).in
output = $(Process).out
queue 51
It's still an RFE,
https://condor-wiki.cs.wisc.edu/index.cgi/tktview?tn=488
Until that is resolved, did you know condor_submit reads from stdin?
$ cat 100.in
hi
$ cat 101.in
bye
$ for i in $(seq 100 101); do echo "cmd = /bin/cat\nargs = $i.in\ninput
= $i.in\noutput = $i.out\nqueue"; done
cmd = /bin/cat
args = 100.in
input = 100.in
output = 100.out
queue
cmd = /bin/cat
args = 101.in
input = 101.in
output = 101.out
queue
$ for i in $(seq 100 101); do echo "cmd = /bin/cat\nargs = $i.in\ninput
= $i.in\noutput = $i.out\nqueue"; done | condor_submit
Submitting job(s)..
1 job(s) submitted to cluster 53.
1 job(s) submitted to cluster 54.
$ condor_q
-- Submitter: localhost.localdomain : <127.0.0.1:10003> :
localhost.localdomain
ID OWNER SUBMITTED RUN_TIME ST PRI SIZE CMD
53.0 matt 8/19 06:56 0+00:00:00 I 0 0.1 cat 100.in
54.0 matt 8/19 06:56 0+00:00:00 I 0 0.1 cat 101.in
2 jobs; 2 idle, 0 running, 0 held
$ condor_q
-- Submitter: localhost.localdomain : <127.0.0.1:10003> :
localhost.localdomain
ID OWNER SUBMITTED RUN_TIME ST PRI SIZE CMD
0 jobs; 0 idle, 0 running, 0 held
$ cat 100.out
hi
$ cat 101.out
bye
You get two clusters because you have multiple cmd/executable lines in
the input to condor_submit. You can get around that if it is a problem.
Best,
matt
On 08/18/2010 10:05 PM, Thomas.Pagano@xxxxxxxx wrote:
I set up a job like (paraphrased)
output = cvfout_$(Process).txt
transfer_input_files = $(Process).7z, foo.exe
queue 100
Where I prepared a directory of data files 0.7z, 1.7z, 2.7z and so on.
It wasn't until my job was done that I realized that I made a typo and
actually wanted to run 150 jobs ("queue 150"). So jobs 0-99 finished but
100-149 didn't. I'd like to run those remaining jobs now without having
to rename/reorder all my files.
Is it possible for me to do something like
output = cvfout_$(Process+100).txt
transfer_input_files = $(Process+100).7z, foo.exe
queue 50
or say,
queue 100 to 150 step 1
or
blarg = `expr $(Process) + 100`
output = cvfout_$(blarg).txt
or
Set /A blarg=%Process%+100
_https://lists.cs.wisc.edu/archive/condor-users/2006-June/msg00261.shtml_ suggests
the process number is hard wired to start at zero but I'm wondering if I
can make a new variable?
Cheers,
Tom
Dr Thomas C. Pagano
CSIRO Land and Water
PO Box 56, Highett, VIC 3190
Phone 03 9252 6342
Mobile 04 5867 4721
Email Thomas.Pagano@xxxxxxxx
_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users
The archives can be found at:
https://lists.cs.wisc.edu/archive/condor-users/