Disdp: Disaggregating Compute, Network, and Storage for Model-Sharded Data-Parallel Training.

Mo Sun, Zihan Yang, Changyue Liao, Yingtao Li, Jie Zhang, Kaiqi Chen, Fei Wu, Zeke Wang

Browse the full ISCA paper archive.