Cooperative Two-Dimensional Hierarchical All-Reduce for Large Language Model Training with Heterogeneous Communication Links.

Xiangming Zhu, Shanyun Liu, Jingfei Chang, Hongyang Chen

Browse the full VTC paper archive.