PacTrain: Pruning and Adaptive Sparse Gradient Compression for Efficient Collective Communication in Distributed Deep Learning.

Yisu Wang, Ruilong Wu, Xinjiao Li, Dirk Kutscher

Browse the full DAC paper archive.