Re: [HTCondor-users] Non-sequential input files?

[Jason Patton <jpatton@xxxxxxxxxxx>]

Emily,

On Tue, Feb 27, 2018 at 8:29 AM, Weiser, Emily <eweiser@xxxxxxxx> wrote:
> Is there any way to refer to a specific sequence of numbers for a batch -
> e.g. instead of using $(Process), can I call the numbers from a text file
> that lists which IDs are actually present?

Assuming a sufficiently new enough version of condor (8.3+ I believe),
you can do this with your queue statement:

transfer_input_files = input_file_$(Number).dat
queue Number from file_with_numbers.txt

For example:

=== submit file
universe = vanilla
executable = /bin/echo
arguments = $(number)
transfer_executable = false

log = log
output = out.$(number)

queue number from numbers.txt
===

=== numbers.txt
1
2
3
5
8
13
===

After jobs have run:
$ ls out.*
out.1  out.13  out.2  out.3  out.5  out.8
$ cat out.*
1
13
2
3
5
8

Jason