A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks.

Shaohuai Shi, Qiang Wang, Kaiyong Zhao, Zhenheng Tang, Yuxin Wang, Xiang Huang, Xiaowen Chu

Browse the full ICDCS paper archive.