Patterns Behind Chaos: Forecasting Data Movement for Efficient Large-Scale Moe LLM Inference.

Zhongkai Yu, Yue Guan, Zihao Yu, Chenyang Zhou, Zhengding Hu, Shuyi Pei, Yangwook Kang, Yufei Ding, Po-An Tsai

Browse the full ISCA paper archive.