Scratch Filesystem Errors Resolved

We have resolved a problem with the Scratch filesystem that gives errors "No space left on device". The cause is that the metadata subsystem is pretty full. The outage was caused be the rapid exhaustion of metadata storage space, the reason for the spike in metadata space utilization is unknown. The scratch filesystem has been returned to service after we worked with the vendor to implement a temporary workaround. We are working with the vendor to find the root cause and a permanent fix for the underlying problem. We apologize for any inconvenience this may cause. We will provide updates if there is risk of further outages. Please contact oschelp@osc.edu if you have any questions.
Display Start: 
Tuesday, October 1, 2019
Display End: 
Wednesday, October 2, 2019
Supercomputer(s):