Accelerating Collective Communication in Data Parallel Training across Deep Learning Frameworks.

Joshua Romero, Junqi Yin, Nouamane Laanait, Bing Xie, M. Todd Young, Sean Treichler, Vitalii Starchenko, Albina Y. Borisevich, Alex Sergeev, Michael A. Matheson

Browse the full NSDI paper archive.