Decentralized SGD and Average-direction SAM are Asymptotically Equivalent.

Tongtian Zhu, Fengxiang He, Kaixuan Chen, Mingli Song, Dacheng Tao

Browse the full ICML paper archive.