We are currently experiencing outages affecting multiple services, including OnDemand (ondemand.osc.edu) and login nodes of HPC systems.

Known issues

Unresolved known issues

Known issue with an Unresolved Resolution state is an active problem under investigation; a temporary workaround may be available.

Resolved known issues

A known issue with a Resolved (workaround) Resolution state is an ongoing problem; a permanent workaround is available which may include using different software or hardware.

A known issue with Resolved Resolution state has been corrected.

Known Issues

Title Category Resolution Description Postedsort descending Updated
Using mpiexec/mpirun with Intel MPI on Slurm Software Resolved
(workaround)

Intel MPI on Slurm batch system is configured to support PMI process manager. It is recommended to use srun as MPI program launcher. If you prefer using mpiexec/... Read more

1 month 11 hours ago 1 month 11 hours ago
MPI-IO issues on home directories with Intel MPI 2019.3 Pitzer, Software Resolved
(workaround)

Certain MPI-IO operations with intelmpi/2019.3 may crash, fail or proceed with errors on the home directory. We do not expect the same issue on our GPFS file system, such as the... Read more

1 month 11 hours ago 1 month 11 hours ago
Singularity: failed to pull a large Docker image Software Resolved
(workaround)

You might encounter an error while pulling a large Docker image:

[pitzer-login01]$ apptainer pull docker://qimme2/core
FATAL: Unable to pull docker://qiime2/core While running... Read more          
1 month 11 hours ago 1 month 11 hours ago
Singularity: failed to run a container directly or pull an image from Singularity or Docker hub Software Resolved
(workaround)

You might encounter an error while run a container directly from a hub:

[pitzer-login01]$ apptainer run shub://vsoch/hello-world
Progress |===================================| 100.0%... Read more          
1 month 11 hours ago 1 month 11 hours ago
WARN SparkSession in Jupyter + Spark instance Software Resolved
(workaround)

You may encounter the following warning message when running a Spark instance using the default PySpark kernel in a Jupyter + Spark application:

WARN SparkSession: Using an... Read more          
1 month 7 hours ago 4 weeks 9 hours ago
STAR error bgzf_open: Assertion failed Cardinal, Software Resolved
(workaround)

You may encounter errors that look similar to these when running STAR 2.7.10b:

STAR: bgzf.c:158: bgzf_open: Assertion `compressBound(0xff00) < 0x10000' failed.

Cause... Read more

4 weeks 11 hours ago 2 weeks 2 days ago
Instability on Clusters after May 13 Downtime Resolved

We've been experiencing some instability on the clusters (particularly Cardinal and Ascend) following the recent May 13 downtime, especially with parallel job processing. If you notice any unusual... Read more

4 weeks 11 hours ago 1 week 2 days ago
Python version mismatch in Jupyter + Spark instance Software Resolved
(workaround)

You may encounter the following error message when running a Spark instance using a custom kernel in the Jupyter + Spark app:

25/04/25 10:49:01 WARN TaskSetManager: Lost task 0.0 in... Read more          
4 weeks 8 hours ago 4 weeks 8 hours ago
NCCL hang on Ascend dual-GPU nodes Ascend, GPU, Software Resolved
(workaround)

Users may encounter the following message and experience NCCL hangs if the first operation is a barrier when running multi-GPU training. We have identified... Read more

2 weeks 2 days ago 1 week 3 days ago
Resolved: Home directory space Issue with MATLAB 2024a Software Resolved

Users may experience their home directory running out of space after executing multiple MATLAB 2024a jobs. This issue is caused by the accumulation of multiple copies of the MathWorks Service... Read more

1 week 2 days ago 1 week 2 days ago

Pages