From Promise to Practice: Realizing High-performance Decentralized Training.

Zesen Wang, Jiaojiao Zhang, Xuyang Wu, Mikael Johansson

Browse the full ICLR paper archive.