Attack of the Bubbles: Straggler-Resilient Pipeline Parallelism for Large Model Training.

Tianyuan Wu, Lunxi Cao, Hanfeng Lu, Xiaoxiao Jiang, Yinghao Yu, Siran Yang, Guodong Yang, Jiamang Wang, Lin Qu, Liping Zhang, Wei Wang

Browse the full NSDI paper archive.