[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Condor-users] Job completion hooks



All,

Here's my issue: on my cluster, I'm handling user notification of job completion instead of letting condor send out those messages - I've automated the process of job submission and file retrieval via a Django website. This process tends to work well - the programs I run are actually scripts, where the first and last lines of the scripts interface with my software and let me know when the job has actually started and stopped. The problem comes in when the generated output files are large and take several minutes to transfer back to the submitting computer; technically the user could receive a completion email and visit the website to download their files before those files have finished transferring.
I've looked into hooks, but the one that seems to run at the latest 
point in the processing chain - HOOK_JOB_EXIT - runs prior to file 
transfer.  I thought about HOOK_JOB_CLEANUP, but the part in the 
documentation about running the specified cleanup script instead of 
Condor's cleanup scripts causes a bit of trepidation regarding that 
route.  Is there any way to run a program once _all_ the steps have 
completed processing without interfering with Condor's inner workings?
Thanks,
Tyler