Caffe is "
From their README:
Caffe is a deep learning framework made with expression, speed, and modularity in mind. It is developed by the Berkeley Vision and Learning Center (BVLC) and by community contributors. Yangqing Jia created the project during his PhD at UC Berkeley. Caffe is released under the BSD 2-Clause license.
Caffe also includes interfaces for both Python and Matlab, which have been built but have not been tested.
The following versions of Caffe are available on OSC clusters:
Version | Owens |
---|---|
1.0.0-rc3 | X* |
You can use module spider caffe
to view available modules for a given machine. Feel free to contact OSC Help if you need other versions for your work.
The current version of Caffe on Owens requires cuda/8.0.44 for GPU calculations.
Caffe is available to all OSC users. If you have any questions, please contact OSC Help.
Berkeley AI Research, Open source
To configure the Owens cluster for the use of Caffe, use the following commands:
module load caffe
Batch jobs can request mutiple nodes/cores and compute time up to the limits of the OSC systems. Refer to Queues and Reservations for Owens, and Scheduling Policies and Limits for more info. In particular, Caffe should be run on a GPU-enabled compute node.
Below is an example batch script (job.txt
) for using Caffe, see this resource for a detailed explanation http://caffe.berkeleyvision.org/gathered/examples/mnist.html
#!/bin/bash #SBATCH --job-name=Caffe #SBATCH --nodes=1 --ntask-per-node=28:gpu #SBATCH --time=30:00 #SBATCH --account <project-account> . /etc/profile.d/lmod.sh # Load the modules for Caffe ml caffe # Migrate to job temp directory and copy folders over cd $TMPDIR cp -r $CAFFE_HOME/{examples,data} . # Download, create, train ./data/mnist/get_mnist.sh ./examples/mnist/create_mnist.sh ./examples/mnist/train_lenet.sh # Serialize log files echo; echo 'LOG 1' cat convert_mnist_data.bin.$(hostname)* echo; echo 'LOG 2' cat caffe.INFO echo; echo 'LOG 3' cat convert_mnist_data.bin.INFO echo; echo 'LOG 4' cat caffe.$(hostname).* cp examples/mnist/lenet_iter_10000.* $SLURM_SUBMIT_DIR
In order to run it via the batch system, submit the job.txt
file with the following command:
sbatch job.txt