FlexSP: Accelerating Large Language Model Training via Flexible Sequence Parallelism.

Yujie Wang, Shiju Wang, Shenhan Zhu, Fangcheng Fu, Xinyi Liu, Xuefeng Xiao, Huixia Li, Jiashi Li, Faming Wu, Bin Cui

Browse the full ASPLOS paper archive.