OSP: Boosting Distributed Model Training with 2-stage Synchronization.

Zixuan Chen, Lei Shi, Xuandong Liu, Jiahui Li, Sen Liu, Yang Xu

Browse the full ICPP paper archive.