Demystifying NCCL: An In-Depth Analysis of GPU Communication Protocols and Algorithms.

Zhiyi Hu, Siyuan Shen, Tommaso Bonato, Sylvain Jeaugey, Cedell Alexander, Eric Spada, James Dinan, Jeff R. Hammond, Torsten Hoefler

Browse the full HOTI paper archive.