Re: [HTCondor-users] How to submit jobs to both Windows and Linux with a single .sub file

[thomas.hartmann@xxxxxxx]

if you don't mind staging both binaries, maybe it could work to symlink
in a PreCmd to the correct binary with something like

if OS == win:
   os.symlink(IWD/bin_win, IWD/bin)
else:
   os.symlink(IWD/bin_linux, IWD/bin)

and execute IWD/bin

On 04/08/2020 12.51, thomas.hartmann@xxxxxxx wrote:
> Hi,
> 
> just plain Linux here, so no promises ;)
> 
> But maybe you can run a pre run script in the job's working dir with
>   +PreCmd = "<executable>"
> to set a switch for the following binary (of course might be difficult
> to have something runable on both OS - maybe Python?)
> 
> CHeers,
>   Thomas
> 
> 
> 
> On 04/08/2020 12.02, jefhque@xxxxxxxxx wrote:
>> Hello everyone,Â
>>
>> I'm working on HTCondor v8.7.9 with a condor pool containing both
>> Windows and Linux machines, and my submit node is a Windows machine. As
>> the executable of Windows cannot execute on Linux, and the executable of
>> Linux cannot execute on Windows either, I need to submit two kinds of
>> executables to run on both Windows and Linux, but I don't know how to
>> write the condor job description (.sub file) to let condor choose the
>> correct executable to execute. I have tried several ways to figure out
>> this, but they don't work:
>>
>>   * I specified the executable with $(OpSys) macro (e.g.
>>     foo.$(OpSys).exe), but I find that the value of the macro is always
>>     "WINDOWS" when I submit with my Windows machine, regardless of the
>>     target machine is Windows or Linux. My thought is that the $(OpSys)
>>     macro is determined as the operating system of the submit machine,
>>     and thus it cannot resolve my issue.
>>   * I also tried to use the condition description (if/else), but it
>>     fails to resolve macros like $(OpSys) and the target machine's
>>     operating system and cause the parsing error when I submit the job.
>>     It seems that the conditions in the submit description file are only
>>     supported for simple static conditions, and dynamic conditions like
>>     choosing executables according to the target machine'sÂoperating
>>     system are not supported.
>>   * Currently, I can statically split the jobs into Windows jobs and
>>     Linux jobs and determine the job numbers of each platform according
>>     to the slot numbers of each platform, but it suffers from undesired
>>     load balance problem, as I cannot perfectly predict the execution
>>     time of each job on each machine.
>>
>> Is there any way to make condor automatically choose the right
>> executable for the target machine's operating system and schedule the
>> jobs for both Windows and Linux without any manual scheduling?Â
>>
>> _______________________________________________
>> HTCondor-users mailing list
>> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
>> subject: Unsubscribe
>> You can also unsubscribe by visiting
>> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>>
>> The archives can be found at:
>> https://lists.cs.wisc.edu/archive/htcondor-users/
>>
>>
>> _______________________________________________
>> HTCondor-users mailing list
>> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
>> subject: Unsubscribe
>> You can also unsubscribe by visiting
>> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>>
>> The archives can be found at:
>> https://lists.cs.wisc.edu/archive/htcondor-users/

Attachment: 0x4C44535B5D7ADD74.asc
Description: application/pgp-keys

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature