Quartet: A Holistic Hybrid Parallel Framework for Training Large Language Models.

Weigang Zhang, Biyu Zhou, Xing Wu, Chaochen Gao, Zhibing Liu, Xuehai Tang, Ruixuan Li, Jizhong Han, Songlin Hu

Browse the full EuroPar paper archive.