OSC OnDemand and cluster login nodes are currently experiencing service degradation and connection issues.

Known issues

Unresolved known issues

Known issue with an Unresolved Resolution state is an active problem under investigation; a temporary workaround may be available.

Resolved known issues

A known issue with a Resolved (workaround) Resolution state is an ongoing problem; a permanent workaround is available which may include using different software or hardware.

A known issue with Resolved Resolution state has been corrected.

Known Issues

Title Category Resolutionsort descending Description Posted Updated
Podman storage error due to outdated configuration file Software Resolved
(workaround)

If you experience a storage error such as:

 write /var/tmp/storage388772891/1: no space left on device.

you may have an outdated ~/....

Read more
1 year 2 months ago 1 year 2 months ago
Owens is in Partial Service Owens Resolved

3:45PM April 3, 2017 Update: GPU nodes on Owens are available. 

206 Owens nodes are not accessible to users due to GPU testing and a bad Ethernet switch. It is expected...

Read more
9 years 6 months ago 9 years 6 months ago
ORCA Bind to CORE Failure Software Resolved
(workaround)

The default CPU binding for ORCA jobs can fail sporadically.  The failure is almost immediate and produces a cryptic error message, e.g.:

...
Read more
3 years 5 months ago 1 year 4 months ago
Oakley Login Node Issues Login Problems Resolved

Currently users connecting via SSH to Oakley may recieve "connection refused" or "connection failed" errors if they were not logged in before this occurred.  Glenn is currently functioning...

Read more
12 years 3 months ago 12 years 3 months ago
Statewide Intel compiler license checkout failures Licensing Resolved

This morning (9/10/14) we updated our Intel compiler licenses. We are seeing some unexpected license checkout failures in the logs (please click through to see details):

10:44:...
Read more
12 years 1 month ago 12 years 2 weeks ago
OnDemand service is not available OnDemand Resolved

Update:

OnDemand service is available again.

Original post:

OnDemand service is not available and won't let users log in. We are working to fix it as soon as we can....

Read more
7 years 8 months ago 7 years 8 months ago
GPFS errors on compute nodes filesystem Resolved

We've seen an increase in transient problems that result in compute nodes losing access to the GPFS file systems for ~5 minutes.

Any jobs running on these nodes accessing files on GPFS may...

Read more
5 years 10 months ago 4 years 10 months ago
PyTorch hangs on dual-gpu node on Ascend Ascend, GPU Resolved
(workaround)

PyTorch can hang on Ascend on dual-GPU nodes

Through internal testing, we have confirmed that the hang issue only occurs on Ascend dual-GPU (nextgen) nodes. We’re still unsure why...

Read more
1 year 5 months ago 1 year 5 months ago
Submit filter bug after downtime Batch Resolved

A change was made to a part of our batch software during the downtime that should have only affected users who are a part of multiple projects. We have found that there is a bug in the changes...

Read more
10 years 8 months ago 10 years 8 months ago
Missing shared library of some mvapich2 modules Owens, Pitzer Resolved

Updates on Feb 25 2022:

This issue is fixed. 

Original Post:

Users may see an issue of missing shared library with some mvapich2 modules...

Read more
4 years 7 months ago 4 years 7 months ago

Pages