BCD-Megatron: A Cost-Effective Training System for Large Language Models.

Zeyu Liu, Yan Li, Yunquan Zhang, Boyang Zhang, Guoyong Jiang, Xin Zhang, Limin Xiao, Weifeng Zhang, Daning Cheng

Browse the full ICDCS paper archive.