EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models.

Jialiang Cheng, Ning Gao, Yun Yue, Zhiling Ye, Jiadi Jiang, Jian Sha

Browse the full ICLR paper archive.