Known issues

Unresolved known issues

Known issue with an Unresolved Resolution state is an active problem under investigation; a temporary workaround may be available.

Resolved known issues

A known issue with a Resolved (workaround) Resolution state is an ongoing problem; a permanent workaround is available which may include using different software or hardware.

A known issue with Resolved Resolution state has been corrected.

Known Issues

Title Category Resolution Description Posted Updatedsort ascending
NCCL 2.29 Performance Regression on Ascend and Pitzer Clusters Ascend, Pitzer, Software Resolved
(workaround)

We have identified a potential performance regression in point-to-point communication when using NCCL version 2.29 on the Ascend and Pitzer clusters, which results...

Read more
3 days 19 hours ago 3 days 19 hours ago
Rolling Reboot of all three HPC clusters beginning July 7 Resolved

A rolling reboot is scheduled to remediate a ptrace vulnerability and safely restore debugger functionality for all clusters, including Ascend, Cardinal, and Pitzer...

Read more
1 month 6 days ago 1 week 6 days ago
ptrace Disabled so Debuggers and Tracers Do Not Work Resolved

ptrace has been disabled globally across all OSC systems to mitigate a newly identified Linux kernel vulnerability. This disables most functionality of debuggers,...

Read more
2 months 3 weeks ago 1 week 6 days ago
Linaro MAP fails to launch in linaro-forge/23.0.4 Cardinal, Software Resolved
(workaround)

Linaro MAP can fail to work in linaro-forge/23.0.4

We recommend to use linaro-forge/25.1.3 instead

2 weeks 1 day ago 2 weeks 1 day ago
cuMemHostRegister Fails with CUDA_ERROR_INVALID_VALUE on RHEL 9.6 Ascend, Cardinal, GPU, system software Resolved

After upgrading the operating system to RHEL 9.6 during the scheduled downtime on May 12, 2026,  applications utilizing UCX (...

Read more
2 months 1 week ago 1 month 1 week ago
STAR-CCM+ OpenMPI Job Failed due to Out-of-Memory Cardinal, Software Resolved
(workaround)

After the scheduled downtime on May 12, 2026, STAR-CCM+ has been encountering out-of-memory errors when running OpenMPI jobs. A message similar to the following...

Read more
2 months 1 week ago 1 month 1 week ago
STAR-CCM+ MPI job failure Cardinal, Software Resolved
(workaround)

STAR-CCM+ encounters errors when running MPI jobs using Intel MPI or Open MPI, displaying the following message:

ib_iface.c:1139 UCX ERROR Invalid active_speed on...
Read more
1 year 9 months ago 1 month 2 weeks ago
Rolling Reboot for Security Fix Resolved

A rolling reboot is in progress to address CVE-2026-23111 (nf_tables logic bug) for all clusters, including Ascend, Cardinal, and Pitzer. Login nodes will be rebooted first and access...

Read more
1 month 3 weeks ago 1 month 2 weeks ago
Temporary Login Node Instability on Ascend Ascend Unresolved

We are currently experiencing temporary instability on the Ascend login nodes, which may result in slow response times or unexpected session disconnects. Our team is actively...

Read more
2 months 1 week ago 1 month 2 weeks ago
Nsight GPU profiler not working due to DCGM conflict GPU, Infrastructure Resolved

UPDATE (Mar 15, 2023)

After the downtime on Mar. 14, 2023, OSC enabled a new Slurm option --gres=nsight. DCGM will be disabled on the nodes for the...

Read more
3 years 5 months ago 2 months 2 weeks ago

Pages