Re: [HTCondor-users] empty output directory locally retrieved while performing transfer to remote storage

[Greg Thain <gthain@xxxxxxxxxxx>]

On 3/10/24 12:51 PM, Benoit Roland wrote:
> The output directory "results" and its subdirectories are transferred 
> to the submit node as well, with an empty content.


Do you mean that the directory tree with subdirectories is transferred 
back, but all the non-directory files are missing? This is surprising.

> Using a configuration with a remap:
>
> use_oauth_services = helmholtz
> should_transfer_files = YES
> transfer_output_files = results
> transfer_output_remaps = "results = 
> helmholtz+https://dcache-desy-webdav.desy.de:2880//pnfs/desy.de/punch/benoit_roland/test_alexander/results";
>
> solves the issue, namely the output directory "results" and its 
> subdirectories are successfully transferred to the remote storage, and 
> nothing to the submit node.


The remap is what we intended to work, but the other way shouldn't be so 
buggy. Let us look into fixing this.


-greg