Add support for NCCL
Author: shi-ericCreated Jan 29, 2025Updated Sep 19, 2026
- All five collective communication functions should be supported: https://docs.nvidia.com/deeplearning/nccl/user-guide/docs/api/colls.html
ncclSendandncclRecvshould also be supported: https://docs.nvidia.com/deeplearning/nccl/user-guide/docs/api/p2p.html- NCCL can be statically linked or dynamically linked, including from conda-forge (https://anaconda.org/conda-forge/nccl)
- Binary size is an obvious concern, so by default dynamically linked NCCL will be assumed.
Source: NVIDIA/warp