Over the past two weeks we have experienced Oakely login node crashes potentially caused by a Lustre bug.


LS-DYNA is a general purpose finite element code for simulating complex structural problems, specializing in nonlinear, transient dynamic problems using explicit integration. LS-DYNA is one of the codes developed at Livermore Software Technology Corporation (LSTC).

Availability & Restrictions

LS-DYNA is available to OSC users that have filled out the appropriate academic license agreement form found here.

Serial (smp -for single node jobs) and parallel (mpp -for multipe node jobs) versions of LS-DYNA solvers are installed at OSC. You may check the available versions on Oakley using module avail dyna. (On Glenn, use module avail lsdyna for smp solvers, and use module avail mpp for mpp solvers.) In the module name, '_s' indicates single precision and '_d' indicates double precision. For example, mpp971_d_R5 is the mpp solver with double precision on Glenn. The following versions are currently available on OSC cluster systems (including smp/mpp, single/double precision):

Version Glenn Oakley
971-R4.2.1 X  
971-R5 X X
971-R5.1.1   X
971-R7.0.0 X X


LS-DYNA can be used via the batch system, by requesting the computing resources and launching solvers (smp/mpp) in a script file. See the following example.

Batch Usage

To use LS-DYNA via the batch system, here's what you need to do:

1) copy your input files (explorer.k in the example below) to your work directory at OSC
2) create a batch script, similar to the following file, saved as 'test.job':

#PBS -N plate_test
#PBS -l walltime=5:00:00
#PBS -l nodes=2:ppn=8
#PBS -j oe
#PBS -S /bin/csh
# The following lines set up the LSDYNA environment
module unload mpi
module load mpp971_d_R5
# Move to the directory where the input files are located
# Run LSDYNA (number of cpus > 1)
mpiexec mpp971 I=explorer.k NCPU=16

     This example script uses the mpp solver for a parallel job (nodes>1) on Glenn. 


  • If you're running mpp on Oakley, you'll need to change the mpi loading due to the different system configuration. Essentially, you need the following command in your script:
    module swap mvapich2/1.7 intelmpi

     in place of

    module unload mpi

      in the above.

  • If a smp solver is launched, a different executable should be used:
#PBS -l nodes=1:ppn=8
module load lsdyna971_d_R5
lsdyna I=explorer.k NCPU=8

 3) submit the script to the batch queue with the command:

qsub test.job

    when the job is finished, all the result files will be found in the directory where you submitted your job ($PBS_O_WORKDIR).

  Alternatively, you can submit your job from the temporary directory ($TMPDIR), which is faster to access for the system and might be beneficial for bigger jobs. Note that $TMPDIR is uniquely associated with the job submitted and will be cleared when the job ends. So you need to copy your results back to your work directory at the end of your script. An example scrip should include the following lines:

cp $PBS_O_WORKDIR/explorer.k .
... #launch the solver and execute
pbsdcp -g '*' $PBS_O_WORKDIR


Further Reading

See Also