A hadoop cluster can be launched within the HPC environment, but managed by the PBS job scheduler using Myhadoop framework developed by San Diego Supercomputer Center. (Please see http://www.sdsc.edu/~allans/MyHadoop.pdf)
The following are technical specifications for Oakley. We hope these may be of use to the advanced user.
This page provides an overview of file systems at OSC. Each file system is configured differently to serve a different purpose:
Abaqus does not run correctly in parallel (multiple nodes) on Owens with input files in $TMPDIR. You need to use scratch file system ($PFSDIR) instead. For more information, see: https://www.osc.edu/resources/available_software/software_list/abaqus
This documentation is to discuss how to set up an interactive parallel COMSOL job at OSC. The following example demonstrates the process of using COMSOL version 5.1 on Oakley. Depending on the version of COMSOL and cluster you work on, there mighe be some differences from the example. Feel free to contact OSC Help if you have any questions.
This document shows you how to use the NFSv4 ACL permissions system. An ACL is a list of permissions associated with a file or directory. These permissions allow you to restrict access to a certian file or directory by user or group. NFSv4 ACLs provide more specific options than typical POSIX read/write/execute permissions used in most systems.
Understanding NFSv4 ACL
This is an example of an NFSv4 ACL
This "how to" will demonstrate how to lower ones' disk space usage. The following procedures can be applied to all of OSC's file systems.
We recommend users regularly check their data usage and clean out old data that is no longer needed.