The NVIDIA Collective Communication Library (NCCL) implements multi-GPU and multi-node communication primitives optimized for NVIDIA GPUs and Networking. NCCL provides routines such as all-gather, all-reduce, broadcast, reduce, reduce-scatter as well as point-to-point send and receive that are optimized to achieve high bandwidth and low latency over PCIe and NVLink high-speed interconnects within a node and over NVIDIA Mellanox Network across nodes.
Availability and Restrictions
Versions
nccl is available on the Owens, Pitzer, and Ascend Clusters. The versions currently available at OSC are:
| Version | Pitzer | Owens | Ascend |
|---|---|---|---|
| 2.11.4 | X* | X* | |
| 2.11.4-1 | X* |
* Current Default Version
You can use module spider nccl to view available modules for a given machine. Feel free to contact OSC Help if you need other versions for your work.
Access
nccl is available to all OSC users. If you have any questions, please contact OSC Help.
Publisher/Vendor/Repository and License Type
NVIDIA, see NVIDIA's links listed here for licensing.
- SLA
- This document is the Software License Agreement (SLA) for NVIDIA NCCL. The following contains specific license terms and conditions for NVIDIA NCCL. By accepting this agreement, you agree to comply with all the terms and conditions applicable to the specific product(s) included herein.
- BSD License
- This document is the Berkeley Software Distribution (BSD) license for NVIDIA NCCL. The following contains specific license terms and conditions for NVIDIA NCCL open sourced. By accepting this agreement, you agree to comply with all the terms and conditions applicable to the specific product(s) included herein.
