Accessing recovered /staging data and updated data timelines

[chtc-users@xxxxxxxxxxx]

Hello CHTC users, 

 

This message is for all users, especially:

• HTC users using the /staging, /projects, or /software directories
• HPC users using the /projects directory

 

/staging and /software update

 

The data recovery process for /staging and /software is complete. We believe we have recovered about 50% of the data that was originally present in these directories. Some of the metadata for files (like file creation date) may be incorrect; we strongly recommend validating any data that you copy from the recovered file system. 

 

Accessing recovered data:

• Any recovered data is available at this path: 
• /recovery/staging/<your username>
• /recovery/software/<your username>
• Users should copy any recovered files they want to save into their new /staging directories. 
• References to data using the paths to recovered staging directories should not be used in job submission. The directories for recovered data are read-only, and you will not be able to write into them. 
• Data in the recovery file system (the paths above) will be available through early February, 2025. 

 

If your directory doesn’t exist in the recovery path, that means that none of your data was recovered. 

 

Updated /projects timeline

 

We are now working on data recovery for /projects folders. Due to the large size of this data store, we anticipate that the recovery process will take longer than /staging and likely stretch into January 2025. 

 

Reminder about group directories

 

If you have a group or project directory, it needs to be recreated via a request to our Quota Request form. Note that these directories are new, empty directories, to be used for your data moving forward. You will be able to copy any recovered data into these directories. Request here: https://chtc.cs.wisc.edu/uw-research-computing/quota-request.html 

 

These updates have been posted on our website and status page: 

• Website: https://chtc.cs.wisc.edu/uw-research-computing/data-recovery-fall2024 
• Status page: https://status.chtc.wisc.edu/ 

 

As always, please contact us at chtc@xxxxxxxxxxx with any particular concerns or questions. 

 

Best,

Your CHTC team