Migrating jobs from other clusters
This page includes a summary of differences to keep in mind when migrating jobs from other clusters to Pitzer.
HPC
HOWTO: IME, Cache & Burst Buffer for Scratch File System
The Owens and Pitzer clusters have access to the DDN Infinite Memory Engine (IME), a fast data tier between the compute nodes and the /fs/scratch file system. IME is a Solid State Disk (SSD) that can act as a cache and burst buffer to improve the performance of the scratch file system.
While some jobs will benefit from using IME, others will not. You need to understand the workflow of IME well, since sometimes it is not very intuitive. Files must be explicitly imported, synchronized and/or purged.
Special Schedulings
Preemption Job
Preemption job is available in general using a new QOS: preemptible.
Jobs that request this QOS will be eligible to be run on reserved condo nodes. However, if other jobs with the appropriate QOS are waiting on those same resources, the preemptible jobs are killed to allow the higher QOS jobs start. Preemption will be done with a minimum runtime before preemption of 15 minutes. Preemptible jobs will be charged at the same rate.
Queues and Reservations
Here are the queues available on Pitzer. Please note that you will be routed to the appropriate queue based on your walltime and job size request.
Batch Limit Rules
Memory Limit:
It is strongly suggested to consider the memory use to the available per-core memory when users request OSC resources for their jobs. See Charging for memory use for more details.
Proposed OSC Policies for Public Comments
This page lists all proposed OSC policies for public comments. Your comments help inform our policies and are encouraged. We will provide the response to comments on this webpage after the public comment period closes. Please submit your comments via our online form by the deadline.
Currently Open for Public Comment:
Overview of File Systems
This page provides an overview of file systems at OSC. Each file system is configured differently to serve a different purpose:
Batch Limit Rules
Memory Limit:
It is strongly suggested to consider the memory use to the available per-core memory when users request OSC resources for their jobs. On Owens, it equates to 4GB/core or 124GB/node.
Queues and Reservations
Here are the queues available on Owens. Please note that you will be routed to the appropriate queue based on your walltime and job size request.
| Name | Nodes available | max walltime | max job size | notes |
|---|---|---|---|---|
|
Serial |
Available minus reservations |
168 hours |
1 node |
Technical Specifications
The following are technical specifications for Owens.
Pages
