3D-INA: An Exploration of Integrating In-Network Aggregation into 3D Parallelism for LLM Training.

Huifeng Xing, Hao Wang, Yinfan Hu, Xin Ai, Zixuan Chen, Yang Chen, Wanxin Shi, Sen Liu, Yang Xu

Browse the full INFOCOM paper archive.