1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed.

Hanlin Tang, Shaoduo Gan, Ammar Ahmad Awan, Samyam Rajbhandari, Conglong Li, Xiangru Lian, Ji Liu, Ce Zhang, Yuxiong He

Browse the full ICML paper archive.