WLB-LLM: Workload-Balanced 4D Parallelism for Large Language Model Training.

Zheng Wang, Anna Cai, Xinfeng Xie, Zaifeng Pan, Yue Guan, Weiwei Chu, Jie Wang, Shikai Li, Jianyu Huang, Chris Cai, Yuchen Hao, Yufei Ding

Browse the full OSDI paper archive.