qstat: cannot connect to server oak-batch-test.osc.edu on Oakley between around 3~3:30pm Nov 21, 2017.
We will have rolling reboots of Oakley and Ruby clusters starting from 8:30AM on Monday October 9, 2017.
12:35PM 5/24/2017 Update:
pbsdcp has been fixed on Oakley.
pbsdcp is not working on Oakley and returns a missing library error as below:
1:40PM 4/27/2017 Update: Rolling reboots are completed.
3:10PM 4/18/2017 Update: Rolling reboots on Owens have started to address GPFS errors occured late Friday.
Rolling reboot of Owens, Oakley, and Ruby clusters is scheduled to start from Wednesday morning, April 19, 2017. Highlights of the rolling reboot activities:
4:56PM 3/28/2017 Update: The rolling reboots of all systems are completed.
Some MVAPICH2 MPI installations on Oakley, Ruby, and Owens, such as the default module mvapich2/2.2 as well as mvapich2/2.1, appear to have a bug that is triggered by certain programs. The symptoms are 1) the program hangs or 2) the program fails with an error related to Allreduce or Bcast.
NAMD 2.11 precompiled binaries do not work. Please use NAMD 2.11 installed from the source and available via module namd/2.11.
The NAMD 2.11 issue involves changes to the command charmrun in Charmm++.
A typical symtom is:
pdsh -j is broken on Oakley. It was broken by updates during the September downtime. We are currently working on resolving the issue.
Users who require a workaround should contact OSC Help for assistance.
Over the past two weeks we have experienced Oakely login node crashes potentially caused by a Lustre bug. The bug (or issue otherwise) seems to be activated when a user does operations on a lustre directory that contains an excessive number of files (10000+ files).
Our support contacts have been contacted and we are working with them to resolve this issue. Updates will be posted both here.
One of the Oakley login nodes (oakley01) has experienced hardware failures and is temporarily out of service while repairs are ongoing.