Office hour change this Thursday (1/24) and new HTC disk enforcement policy


Date: Wed, 23 Jan 2019 11:11:42 -0600
From: chtc-users@xxxxxxxxxxx
Subject: Office hour change this Thursday (1/24) and new HTC disk enforcement policy
Hello CHTC users,

This week's Thursday office hours (1/24) will be in a different location than usual. Tomorrow you can find the CHTC facilitators on the main floor of the Discovery Building in "Hub Central" (the west side of the building), during the usual office hours time (3:00 - 4:30pm).

A reminder to all users of our high throughput computing (HTC) system: as of last night, jobs that use more disk than they request will be put on hold. See our previous email below for more details.Â

Cheers,
CHTC's Research Computing Facilitators

---------- Forwarded message ---------
Date: Fri, Jan 18, 2019 at 11:16 AM
Subject: HTC System to hold jobs over-using disk as of 2019-01-23

For users of CHTC's HTC System:
(users of the HPC Cluster can ignore)

As we continue to improve CHTC compute systems, we will be implementing new HTCondor policy to place jobs on hold for using more 'disk' (file space used within a running job) than specified by the user's submit file under "request_disk". This change will take effect on or after next Wednesday, January 23Âsuch that users with jobs that use more disk than requested will see their jobs placed on hold with a corresponding hold reason in the HTCondor job log file. This change will help to make sure that the jobs of some users are not running a server out of disk space, thereby affecting the jobs of other users running on the same server, which has been a recently increasing problem over the last year.

As with memory over-use, users will need to modify their disk request values of any held jobs before resubmitting. As always, we recommend that you review the log files of your recent jobs and new tests before deciding on memory and disk requests so that your jobs are requesting values only slightly above what you expect the jobs to use. It's almost always worth testing a few jobs for these values before submitting many jobs, in order to avoid delays caused by holds for overuse or longer queue wait times for jobs requesting much more than they truly need.

If you have any questions about how to choose the 'right' request for memory or disk for your HTC jobs, we're very happy to help! Just send an email to chtc@xxxxxxxxxxx to get in touch.

Thank you,
CHTC's Research Computing Facilitators
_______________________________________________
CHTC-users mailing list
CHTC-users@xxxxxxxxxxx
To unsubscribe send an email to:
chtc@xxxxxxxxxxx
https://lists.cs.wisc.edu/mailman/listinfo/chtc-users
[← Prev in Thread] Current Thread [Next in Thread→]
  • Office hour change this Thursday (1/24) and new HTC disk enforcement policy, chtc-users <=