Re: [Condor-users] Submitting Multiple Executables with a Single Submission Script

[Ian Chesal <ichesal@xxxxxxxxxxxxxxxxxx>]

On Wed, Apr 25, 2012 at 4:43 PM, Alex N <aoflex@xxxxxxxxx> wrote:

Does the $(Process) macro not work for 'executable'? If so, is there some other built in Condor function or macro that will quickly submit more than one executable?

It works, but not well. The executable _expression_ is, if I recall correctly, only evaluated once for the entire cluster. So $(Process) == 0 when it's eval'ed the first time and this evaluated version of executable is what gets used among all the jobs in the cluster.

You could use a wrapper script to fix this where the wrapper is something like:

    #!/bin/sh

    script.$1

And your submission script becomes:

universe  = vanilla

requirements  = Arch == "X86_64" && OpSys == "LINUX"

executable  = wrapper.sh

arguments = $(Process)

transfer_input_files = script.$(Process), A, B, C

should_transfer_files  = YES

when_to_transfer_output  = ON_EXIT_OR_EVICT

output  = output.$(Process)

error  = error.$(Process)

log  = logs.$(Process)

queue 999

Regards,

- Ian

--

Ian Chesal

Cycle Computing, LLC

Leader in Open Compute Solutions for Clouds, Servers, and Desktops

Enterprise Condor Support and Management Tools

888.292.5320

http://www.cyclecomputing.com

http://www.cyclecloud.com

http://twitter.com/cyclecomputing