Beyond A Single AI Cluster: A Survey of Decentralized LLM Training.

Haotian Dong, Jingyan Jiang, Rongwei Lu, Jiajun Luo, Jiajun Song, Bowen Li, Ying Shen, Zhi Wang

Browse the full EMNLP paper archive.