Re: [HTCondor-users] Non-sequential input files?

["Weiser, Emily" <eweiser@xxxxxxxx>]

Excellent - I will give that a try. Thanks so much!

Emily

Emily L. Weiser, PhD

United States Geological Survey

Upper Midwest Environmental Sciences Center

2630 Fanta Reed Rd

La Crosse, WI 54603

(608) 781-6193

eweiser@xxxxxxxxÂ

On Tue, Feb 27, 2018 at 8:44 AM, Jason Patton <jpatton@xxxxxxxxxxx> wrote:

Emily,

On Tue, Feb 27, 2018 at 8:29 AM, Weiser, Emily <eweiser@xxxxxxxx> wrote:
> Is there any way to refer to a specific sequence of numbers for a batch -
> e.g. instead of using $(Process), can I call the numbers from a text file
> that lists which IDs are actually present?

Assuming a sufficiently new enough version of condor (8.3+ I believe),
you can do this with your queue statement:

transfer_input_files = input_file_$(Number).dat
queue Number from file_with_numbers.txt

For example:

=== submit file
universe = vanilla
executable = /bin/echo
arguments = $(number)
transfer_executable = false

log = log
output = out.$(number)

queue number from numbers.txt
===

=== numbers.txt
1
2
3
5
8
13
===

After jobs have run:
$ ls out.*
out.1Â out.13Â out.2Â out.3Â out.5Â out.8
$ cat out.*
1
13
2
3
5
8

Jason
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@cs.wisc.edu with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/