Scaling Beyond the GPU Memory Limit for Large Mixture-of-Experts Model Training.

Yechan Kim, Hwijoon Lim, Dongsu Han

Browse the full ICML paper archive.