Re: [HTCondor-users] HTCondor: job outputs not cleaned up?

[Brian Bockelman <bbockelm@xxxxxxxxxxx>]

Hi Thomas,

You might benefit from the âMOUNT_UNDER_SCRATCHâ option.  This uses a bind mount to cause directories besides $_CONDOR_SCRATCH_DIR to specific to the job itself.

For example, if you set:

MOUNT_UNDER_SCRATCH=/tmp, /var/tmp, /var/jobs

then anything written to those directories by job A will not be visible to job B (and will be cleaned automatically).

Brian

> On Feb 8, 2016, at 8:55 AM, Thomas Hartmann <thomas.hartmann@xxxxxxx> wrote:
> 
> Hi all,
> 
> nodes in our test cluster are filling up with left-overs from old jobs.
> We are wondering, if we have missed something in the configuration but
> would expect, that normally the jobs would be cleaned up?
> 
> An example node has left hardly any space
>> /dev/sda6 71G 65G 2.2G 97% /var
>> wn13-test > find /var/jobs/ -mtime +7 | wc -l
> 315282
> 
> with the majority being old files from previous jobs.
> 
> How can we ensure, that remnants from finished jobs are being cleaned up
> properly?
> 
> Cheers and thanks,
>  Thomas
> 
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/