Enabling Parallelism Hot Switching for Efficient Training of Large Language Models.

Hao Ge, Fangcheng Fu, Haoyang Li, Xuanyu Wang, Sheng Lin, Yujie Wang, Xiaonan Nie, Hailin Zhang, Xupeng Miao, Bin Cui

Browse the full SOSP paper archive.