Updates on May 20 2023:
verbsRDMA is enabled on Pitzer.
Updates on Dec 14 2022:
verbsRDMA is enabled on Owens during December 13 downtime. verbsRDMA remains disabled on Pitzer.
To prepare for expansion of the IBM Elastic Storage System (ESS), the data transfer is switched from InfiniBand (IB) verbsRDMA to IP over IB (IPoIB) after August 9th's downtime. This may cause some impact to the job performance.
Disabling verbsRDMA is only temporary and we will re-enable it in the next couple months once we're able to upgrade the HPC clusters to a version of the InfiniBand libraries compatible with the ESS upgrades/expansion.
Please contact OSC Help if you see any issue or have any questions.