Nextflow
Nextflow is a workflow system for creating scalable, portable, and reproducible workflows. Nextflow is based on the dataflow programming model which simplifies complex distributed pipelines.
Ascend
System Downtime December 19 2023
A downtime for OSC HPC systems is scheduled from 7 a.m. to 9 p.m., Tuesday, December 19, 2023. The downtime will affect the Pitzer, Owens and Ascend Clusters, web portals, HPC file servers, and state-wide licenses. MyOSC (the client portal) will be available during the downtime. In preparation for the downtime, the batch scheduler will not start jobs that cannot be completed before 7 a.m., December 19. Jobs that are not started on clusters will be held until after the downtime and then started once the system is returned to production status.
Nodejs
Nodejs is used to create server-side web applications, and it is perfect for data-intensive applications since it uses an asynchronous, event-driven model
Running jobs requeued on all clusters
The Slurm upgrades during rolling reboots of Ascend, Owens and Pitzer we performed today (Oct 25 2023) cause all running jobs on the systems requeued around 8:45am. You will not be billed for the consumed resources before the jobs were requeued.
Rolling reboot of all clusters starting from Oct 25 2023
We will have rolling reboots of Ascend, Owens and Pitzer clusters including login and compute nodes, starting from 9AM Wednesday October 25, to perform NVIDIA driver and Slurm upgrades. At the start of the rolling reboot all login nodes will be unavailable for about 10 minutes. The rolling reboots won't affect any running batch jobs, but users may experience longer queue wait time than usual on the clusters.
HOWTO: Run Python in Parallel
We can improve performace of python calculation by running python in parallel. In this turtorial we will be making use of the multithreading library to run python code in parallel.
HOWTO: Use GPU in Python
If you plan on using GPUs in tensorflow or pytorch see HOWTO: Use GPU with Tensorflow and PyTorch
This is an exmaple to utilize a GPU to improve performace in our python computations. We will make use of the Numba python library. Numba provides numerious tools to improve perfromace of your python code including GPU support.
System Downtime August 8 2023
A downtime for OSC HPC systems is scheduled from 7 a.m. to 9 p.m., Tuesday, August 8, 2023. The downtime will affect the Pitzer, Owens and Ascend Clusters, web portals, and HPC file servers. MyOSC and state-wide licenses will be available during the downtime. See this link for more details: https://www.osc.edu/calendar/events/2023_08_08-system_downtime_august_8_2023
Gromacs 2023.2 is available
Gromacs 2023.2 has been installed on all the clusters. Usage is via the module gromacs/2023.2. For help loading an installation, use the command: "module spider gromacs/2023.2". That command also emits information on usage and installation details.
Rolling reboot of all clusters starting from June 14 2023
Beginning 9am on Wednesday, June 14, we will be having rolling reboots of all clusters (Owens, Pitzer, and Ascend). This includes both login and compute nodes and will be done to perform OS updates. Login nodes will be rebooted at 9am on June 14, which will leave them unavailable for approximately 5-10 minutes. The rolling reboots won't affect any running batch jobs, but users may experience longer than usual wait times on all clusters.
