Hypertron: Efficiently Scaling Large Models by Exploring High-Dimensional Parallelization Space.

Shigang Li, Jingkun Dong, Jihao Chen, Zhi Ma, Zhongzhe Hu

Browse the full SC paper archive.