Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training.

Sun Ao, Weilin Zhao, Xu Han, Cheng Yang, Xinrong Zhang, Zhiyuan Liu, Chuan Shi, Maosong Sun

Browse the full NAACL paper archive.