Often users want to submit a large amount of jobs all at once with each using different parameters for each job. These parameters could be anything, including the path of a data file or different input values for a program. This how-to will show you how you can do this using a simple python script, a CSV file, and a template script. You will need to adapt this advice for your own situation.
PnetCDF is a library providing high-performance parallel I/O while still maintaining file-format compatibility with Unidata's NetCDF, specifically the formats of CDF-1 and CDF-2. Although NetCDF supports parallel I/O starting from version 4, the files must be in HDF5 format. PnetCDF is currently the only choice for carrying out parallel I/O on files that are in classic formats (CDF-1 and 2). In addition, PnetCDF supports the CDF-5 file format, an extension of CDF-2, that supports more data types and allows users to define large dimensions, attributes, and variables (>2B elements).
The Ohio Supercomputer Center provides High Performance Computing resources and expertise to academic researchers across the State of Ohio. Any paper citing this document has utilized OSC to conduct research on our production services. OSC is a member of the Ohio Technology Consortium, a division of the Ohio Department of Higher Education.
OSC has operated a number of supercomputer systems over the years. Here is a list of previous machines and their specifications.
Here are the queues available on Ruby. Please note that you will be routed to the appropriate queue based on your walltime and job size request.
|Name||Nodes available||max walltime||max job size||notes|
Batch requests are handled by the TORQUE resource manager and Moab Scheduler as on the Oakley system. Use the
qsub command to submit a batch request,
qstat to view the status of your requests, and
qdel to delete unwanted requests. For more information, see the manual pages for each command.
There are some changes for Ruby, they are listed here:
C, C++ and Fortran are supported on the Ruby cluster. Intel, PGI and GNU compiler suites are available. The Intel development tool chain is loaded by default. Compiler commands and recommended options for serial programs are listed in the table below. See also our compilation guide.