MegaScale-Omni: A Hyper-Scale, Workload-Resilient System for MultiModal LLM Training in Production.

Chunyu Xue, Yangrui Chen, Jianyu Jiang, Ningxin Zheng, Junda Feng, Jingji Chen, Shixiong Zhao, Shen Yan, Yi Lin, Lei Shi, Zanbo Wang, Lishu Luo, Faming Wu, Haibin Lin, Yanghua Peng, Xin Liu, Quan Chen

Browse the full EuroSys paper archive.