Re: Major CHTC outage


Date: Thu, 30 Apr 2026 22:26:59 +0000
From: chtc-users@xxxxxxxxxxx
Subject: Re: Major CHTC outage
Hello CHTC users,

CHTC services (including HTC and HPC) are offline while we patch a serious Linux vulnerability.

Last evening, a serious Linux exploit was broadly published online. This exploit allows any user to easily obtain root (admin) access, bypassing standard security controls. 

We pre-emptively shut down our systems this morning to protect our system and users. We are working to patch the vulnerability on our systems. CHTC servers will remain offline through tomorrow (and possibly longer). 

We will share more updates as the situation changes. We will provide the most up-to-date status of the system on our status page: https://status.chtc.wisc.edu/incidents/8zycydmtkf74.

In the meantime, please review the new Security Policies page to learn what you can do to keep CHTC systems safe and to report security incidents: https://chtc.cs.wisc.edu/uw-research-computing/security.

Best,
Your CHTC team


From: Andrew Owen
Sent: Thursday, April 30, 2026 10:36 AM
To: chtc-users--- via CHTC-users <chtc-users@xxxxxxxxxxx>
Subject: Major CHTC outage
 
Hello CHTC users,

We have shut down all CHTC servers (HTC and HPC) to perform emergency maintenance.

Users are unable to login and there are no running jobs. This includes researcher-owned CHTC-managed APs. BadgerCompute and OpenOnDemand have also been disabled. 

We are actively working to fix the issue but cannot give an ETA at this time.

We realize that this is a significant interruption to your work, but this decision was necessary to ensure the safety and security of our systems. 

We will share updates as they become available via our status page: https://status.chtc.wisc.edu/incidents/8zycydmtkf74.  

We appreciate your patience as we address this issue.

Best,
Your CHTC team


[← Prev in Thread] Current Thread [Next in Thread→]
  • Major CHTC outage, chtc-users
      <Possible follow-up(s)>
    • Re: Major CHTC outage, chtc-users <=