Re: [HTCondor-users] Transfer out files question

["Mick T." <timony@xxxxxxxxxxxxxxxxxxx>]

I think you need to remove the backslashes, and replace

TRANSFER_OUTPUT_FILES = A/myfile.txt/, B/myfile.txt/Â

withÂ

TRANSFER_OUTPUT_FILES = A/myfile.txt, B/myfile.txt

Tho' that may put the files in the current directory and overwrite one of the files with the other. So you may want to use theÂtransfer_output_remaps option, or easier still rename both files so there's name collision.

See the docs at:Âhttp://research.cs.wisc.edu/htcondor/manual/current/condor_submit.html

"When a path to an output file or directory is specified, it specifies the path to the file on the execute side. As a destination on the submit side, the file is placed in the job's initial working directory, and it is named using the base name of the original path. For example,Âpath/to/output_fileÂbecomesÂoutput_fileÂin the job's initial working directory. The name and path of the file that is written on the submit side may be modified by usingÂtransfer_output_remaps. Note that this remap function only works with files but not with directories."

Cheers!

--Â

Mick Timony
Team Lead &ÂScientific Web Services Developer
SBGridÂCoreÂ- SBGrid.org
Harvard Medical School
--

On Wed, Aug 30, 2017 at 12:20 PM, Dan, Bowen <bowen.dan@xxxxxxxx> wrote:

Hi,

Â

I have a question regards to how the transfer out files work. Currently on the execute machine, I have two folders A and B, both contains a considerable amount of data, the two directories both have a file named âmyfile.txtâ. It would be like this:

A/myfile.txt and B/myfile.txt. Instead of transferring whole directories (A and B) back to the submit machine, I only want to transfer A/myfile.txt, B/myfile.txt. So far, I have tried the following:

Â

TRANSFER_OUTPUT_FILES = A/myfile.txt/, B/myfile.txt/

Â

Unfortunately, it did not work. I was wondering if there is a way for me to only transfer the desired files back?

Â

Appreciate your help!

Â

Best,

Bowen

Â

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@cs.wisc.edu with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/