We are actively investigating intermittent slowness on the shared /fs/scratch filesystem.

OSC systems staff will execute a rolling reboot across all active compute clusters (Pitzer, Ascend, and Cardinal) beginning Thursday, November 05.

Known issues

Unresolved known issues

Known issue with an Unresolved Resolution state is an active problem under investigation; a temporary workaround may be available.

Resolved known issues

A known issue with a Resolved (workaround) Resolution state is an ongoing problem; a permanent workaround is available which may include using different software or hardware.

A known issue with Resolved Resolution state has been corrected.

Known Issues

Title Category Resolutionsort descending Description Posted Updated
GPU Memory Not Released Causing OOM in Subsequent Jobs GPU Resolved
(workaround)

We have noticed that GPU memory is not being properly released in some jobs, causing subsequent jobs on the same nodes to run out of memory (OOM). We are currently working on a resolution...

Read more
1 year 1 month ago 8 months 1 week ago
Lustre is still offline. HPC systems back up Maintenance Resolved

Day One of the scheduled downtime has been completed, and HPC operations have resumed. As planned, Lustre work will extend into Day Two. Jobs using /fs/lustre or $PFSDIR cannot run until this work...

Read more
12 years 4 months ago 12 years 4 months ago
OnDemand unresponsive login Resolved

Some of the login nodes on Owens and Pitzer are in bad states. User can't log into OnDemand. And scratch is unresponsive sometimes. We are working on this issue. We will update when we have more...

Read more
6 years 5 months ago 6 years 5 months ago
Scheduling suspended Batch Resolved

We have temporarily suspended scheduling due to some problems with the parallel scratch file system.

12 years 1 month ago 12 years 1 month ago
Client Portal inaccessible client portal Resolved

All users are currently unable to login to OSC client portal.

When attempting to login to OSC...

Read more
5 years 11 months ago 5 years 11 months ago
NFS outage on Thursday Jan 17 from 7am to 8am filesystem Resolved

Update:

This work has been canceled and will be done during downtime on Feb. 5. 

Original Post:

On Thursday, January 17th from 7 am to 8 am OSC will have a GPFS...

Read more
7 years 10 months ago 7 years 10 months ago
Intermittent failure of default CPU binding Software Resolved
(workaround)

The default CPU binding for ORCA jobs can fail sporadically.  The failure is almost immediate and produces a cryptic error message, e.g.

$ORCA/orca h2o.in...
Read more
1 year 6 months ago 1 year 6 months ago
June 7th downtime to finish at 6:30PM Connectivity, filesystem, Infrastructure, login, Login Problems, Maintenance, Operations, Outage Resolved

Update: Downtime completed at 6:30PM, June 7th.

 

The June 7th downtime is now slated to be completed at 6:30PM.  Previous estimate was 5PM.

All systems and services will...

Read more
10 years 5 months ago 10 years 5 months ago
MyOSC may not show usage for 28 March 2022 client portal Resolved

MyOSC may not show job usage for 28 March 2022. There is only partial job data for this date at the moment.

Resolution notes:

The job usage for...

Read more
4 years 7 months ago 4 years 7 months ago
Poor network performance on some filesystems filesystem Resolved

We are experiencing some network performance issues on a cluster of servers involved with providing GPFS and some project filesystems. GPFS appears to be functioning acceptably, but proj01, proj02...

Read more
13 years 3 months ago 13 years 3 months ago

Pages