Re: [HTCondor-users] JOB_IS_FINISHED_* config options not removing jobs with delay

[Mary Hester <maryh@xxxxxxxxx>]

Hi TJ, Stefano,

Thanks for you responses and clarification.

We wouldn't want this to be something that requires user action but likely a JobTransform if that is what is needed. (Thanks @Stefano! I will look at implementing your _expression_.)

During the EU HTCondor week a few weeks ago, Todd T. had mentioned that there was a knob for delaying the job leaving the queue too quickly so I was thinking the JOB_IS_FINISHED would be that knob but that is not the case. :)

Thanks for the help!

Mary

On 11/10/2024 16:25, Stefano Belforte wrote:

Hi TJ

Maybe you meant OnExitHold ? Simply toggling OnExitRemoveto to False will set it to Idle again and make it run again (IIUC the doc).

As an additional data point, we are using LeaveJobInQueue to keep jobs in the queue (and hence visible via condor_q) for some time w/o changing the job status, e.g.

LeaveJobInQueue = ifThenElse((JobStatus=?=4 || JobStatus=?=3) && (time() - EnteredCurrentStatus < 30 * 60*60), true, false)

Of course that needs to be done in the jobs submission, it is not a schedd config.

Maybe Mary wants something that can be enforced in the schedd w/o users action ? A JobTransform ?

Stefano

On 11/10/2024 16:02, John M Knoeller via HTCondor-users wrote:

These config knobs are meant to throttle the rate at which the Schedd will spend time removing jobs from the queue, not to provide a way to delay removal. Â

So the delay value is measured from the time the first job is ready to be removed, there is not a separate timer for each job.ÂÂ

Also using these throttling knobs will affect condor_rm as well as job completion, which is probably not what you want.Â

The way to have jobs remain in the queue after they are completed is to use the OnExitRemove _expression_ of the job. And to have them removed at some time in the future you can use SYSTEM_PERIODIC_REMOVE, or the PeriodicRemove _expression_ of the job.

-tj

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/