Re: [HTCondor-users] Should we specify output/error files in transfer_output_files?

[Alexandre Boyer <alexandre.franck.boyer@xxxxxxx>]

Hello,

Sorry for the very late reply.

Indeed, the jobs were not entering the 'C' state.

I confirm that it works now, thank you very much!

Best regards,

Alexandre

On 6/25/25 20:58, Tim Theisen wrote:
> Hello Alexandre,
>
> You do not need to output, error, or log file in transfer output file 
> list. Are you sure that you waited for the job to enter the 'C' state 
> before requesting the files to come back. Running a quick test here 
> showed the local spooling worked. We would need something more 
> specific to reproduce your problem.
>
> ...Tim
>
> On 6/23/25 07:35, Alexandre Boyer via HTCondor-users wrote:
> > Dear HTCondor experts,
> >
> > I hope you are doing well!
> > We currently have the following classad attributes in our submission 
> > script:
> >
> > ```
> > # Outputs: stdout, stderr, log
> > output = $(Cluster).$(Process).out
> > error = $(Cluster).$(Process).err
> > log = $(Cluster).$(Process).log
> >
> > # No other files are to be transferred
> > transfer_output_files = ""
> >
> > # Transfer outputs, even if the job is failed
> > should_transfer_files = YES
> > when_to_transfer_output = ON_EXIT_OR_EVICT
> > ```
> >
> > These options are used in 2 different contexts:
> >
> > - using a remote schedd (grid sites): `condor_submit -terse -pool 
> > <remote_schedd>:9619 -remote <remote_schedd>` (expected to be 
> > equivalent to `-spool` for inputs/output files)
> >
> > - using a local schedd (local cluster): `condor_submit -spool <job>`
> >
> >
> > To retrieve the output, we are just using `condor_transfer_data 
> > <cluster_id>.<process_id>`:
> > - using a remote schedd, we get the `output`, `error` and `log` files 
> > in `initialdir`.
> > - using a local schedd, we don't get anything and the command is not 
> > failing (`Fetching data files...`, `echo $?` gives me `0`). Is that 
> > expected?
> >
> > Do you know why I can't get the output files using a local schedd? Is 
> > that because I have `transfer_output_files = ""`?
> >
> > The documentation is not very clear about whether we should include 
> > the `output/error/log` values in `transfer_output_files`.
> > Do you have any recommendation?
> >
> >
> > Note: I am mostly using remote schedds, and I just interact with a 
> > single local schedd right now.
> >
> > Thanks a lot,
> > Alexandre (for the LHCb experiment)
> >
> > _______________________________________________
> > HTCondor-users mailing list
> > To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx 
> > with a
> > subject: Unsubscribe
> >
> > Join us in June at Throughput Computing 25: 
> > https://urldefense.com/v3/__https://osg-htc.org/htc25__;!!Mak6IKo!K8FOa2pmbISuSgJTMahWWX-1pX4O31qhtnJzDl7UcDuQl4p1PrTeniE4A6kTgO0JxMmykRkUNRmUFWDJFa8qXx6gRcMx$ 
> >
> > The archives can be found at: 
> > https://www-auth.cs.wisc.edu/lists/htcondor-users/