Re: [HTCondor-users] Non-sequential input files?

[Michael Pelletier <Michael.V.Pelletier@xxxxxxxxxxxx>]

You can also iterate over a list variable within the submit description - this is how I handled this sort of problem before the advent of the "queue matching" syntax.

	-Michael Pelletier.

-----Original Message-----
From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf Of Jason Patton
Sent: Tuesday, February 27, 2018 9:45 AM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: [External] Re: [HTCondor-users] Non-sequential input files?

Emily,

On Tue, Feb 27, 2018 at 8:29 AM, Weiser, Emily <eweiser@xxxxxxxx> wrote:
> Is there any way to refer to a specific sequence of numbers for a 
> batch - e.g. instead of using $(Process), can I call the numbers from 
> a text file that lists which IDs are actually present?

Assuming a sufficiently new enough version of condor (8.3+ I believe), you can do this with your queue statement:

transfer_input_files = input_file_$(Number).dat queue Number from file_with_numbers.txt

For example:

=== submit file
universe = vanilla
executable = /bin/echo
arguments = $(number)
transfer_executable = false

log = log
output = out.$(number)

queue number from numbers.txt
===

=== numbers.txt
1
2
3
5
8
13
===

After jobs have run:
$ ls out.*
out.1  out.13  out.2  out.3  out.5  out.8 $ cat out.*
1
13
2
3
5
8

Jason
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/