Known issues

Unresolved known issues

Known issue with an Unresolved Resolution state is an active problem under investigation; a temporary workaround may be available.

Resolved known issues

A known issue with a Resolved (workaround) Resolution state is an ongoing problem; a permanent workaround is available which may include using different software or hardware.

A known issue with Resolved Resolution state has been corrected.

Known Issues

Title Category Resolution Description Posted Updated
Handling full-node MPI warnings with MVAPICH 3.0 Ascend, Cardinal, Pitzer, Software Resolved
(workaround)

When running a full-node MPI job with MVAPICH 3.0 , you may encounter the following warning message:

[][mvp_generate_implicit_cpu_mapping] WARNING: You appear to be... Read more          
1 year 3 months ago 1 day 2 hours ago
Apptainer apt GPG Error Caused by Private /tmp Software Unresolved
(workaround)

On any compute node, users may encounter the following error when installing packages with apt in Apptainer:

W: GPG error: http://security.ubuntu.com/ubuntu focal-... Read more          
1 day 23 hours ago 1 day 23 hours ago
GPU/VIS nodes for various OOD apps are broken Cardinal, OnDemand, Outage, Software Unresolved
(workaround)

After the most recent downtime we discovered that various OOD apps relying on the "virtualgl" module on Cardinal are broken

The following apps are broken... Read more

5 days 17 hours ago 5 days 17 hours ago
Schrodinger 2023.2 does not launch Software Unresolved
(workaround)

Schrodinger 2023.2 does not launch through OnDemand or OnDemand desktop, failing with "fatal error"

When checking the license logs, the error is that the "... Read more

1 month 2 weeks ago 1 week 2 days ago
Apptainer container builds fail on compute nodes due to /tmp namespace behavior Software Resolved

Building Apptainer containers on compute nodes may fail during apt update or other package operations... Read more

4 weeks 1 day ago 1 week 2 days ago
Matlab parallel pool cannot connect Matlab, Pitzer Unresolved

In some cases, matlab will hang with connecting to parallel pool on Pitzer. This was discovered in the 2026 January downtime. We are still investigating

4 weeks 1 day ago 4 weeks 1 day ago
MVAPICH 3.0 hang due to PMI mismatch with Slurm Software Resolved
(workaround)

Applications such as Quantum ESPRESSO, LAMMPS, and NWChem experienced hangs with MVAPICH 3.0 due to a PMI mismatch. MVAPICH 3.0 was built with PMI-1, while newer Slurm versions on RHEL 9... Read more

4 months 1 day ago 1 month 2 weeks ago
Python version mismatch in Jupyter + Spark instance Software Resolved
(workaround)

You may encounter the following error message when running a Spark instance using a custom kernel in the Jupyter + Spark app:

25/04/25 10:49:01 WARN TaskSetManager:... Read more          
8 months 3 weeks ago 1 month 3 weeks ago
AlphaFold 3 Warning: NVIDIA Driver Version Mismatch Software Resolved

While running AlphaFold 3, you may encounter the following warning message:

025-08-27 12:44:10.888652: W external/xla/xla/service/gpu/nvptx_compiler.cc... Read more          
5 months 4 days ago 2 months 4 days ago
AlphaFold 3 GPU Out-of-Memory Error During Inference Software Resolved
(workaround)

When you run AlphaFold 3, you may encounter a GPU out-of-memory (OOM) failures during model execution. The job terminated with errors similar to:

Can't... Read more          
2 months 1 week ago 2 months 1 week ago

Pages