Re: [HTCondor-users] Unexpected File Transfer Behavior Windows to Linux

[Zach Miller <zmiller@xxxxxxxxxxx>]

Hi Will,

This sounds like a bug related to translating the directory delimiter, which is '\' on Windows and '/' on Linux.  I've made a ticket and it should be an easy fix:
  
  https://htcondor-wiki.cs.wisc.edu/index.cgi/tktview?tn=6302



There may be a possible workaround, though very ugly, using transfer_output_remaps.  I haven't tested it at all, and using a backslash within there may be tricky due to the quoting rules.  If I had to guess, you could try this in your submit file:

  transfer_output_remaps = "results\\output.h5=results/output.h5"


Cheers,
-zach


> -----Original Message-----
> From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf
> Of Deck, William
> Sent: Wednesday, June 14, 2017 8:41 AM
> To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
> Subject: [HTCondor-users] Unexpected File Transfer Behavior Windows to
> Linux
> 
> Hello All,
> 
> 
> 
> I am currently running into an issue trying to transfer output from a
> Windows (2012R2) Exec back to a Linux (SLES11SP3) schedd.  The job creates
> a directory named results in the condor execute directory and writes output
> there.  Then based on the submit file Condor tries to copy the results
> directory back to the schedd.  However it looks like it gets confused about
> the file name and ends up creating a file called results\output.h5 on the
> schedd instead of putting output.h5 into the results directory.  Am I doing
> something incorrectly or is there some undefined behavior pulling files
> back from a Windows exec?  Thanks in advance for any help and please let me
> know if you need any more information.
> 
> 
> 
> Relevant submit information:
> 
> transfer_output_files = results
> 
> should_transfer_files = yes
> 
> WhenToTransferOutput = ON_EXIT_OR_EVICT
> 
> 
> 
> Job directory (After job runs):
> 
> job.submit
> 
> job.bat
> 
> log/
> 
> postscript.sh
> 
> results/
> 
> results\output.h5  (output file)
> 
> spread19_20170404_001.yaml
> 
> 
> 
> --
> 
> Will Deck
> 
> 
> 
> 
> ________________________________
> 
> 
> IMPORTANT: The information contained in this email and/or its attachments
> is confidential. If you are not the intended recipient, please notify the
> sender immediately by reply and immediately delete this message and all its
> attachments. Any review, use, reproduction, disclosure or dissemination of
> this message or any attachment by an unintended recipient is strictly
> prohibited. Neither this message nor any attachment is intended as or
> should be construed as an offer, solicitation or recommendation to buy or
> sell any security or other financial instrument. Neither the sender, his or
> her employer nor any of their respective affiliates makes any warranties as
> to the completeness or accuracy of any of the information contained herein
> or that this message or any of its attachments is free of viruses.