Diff-MoE: Efficient Batched MoE Inference with Priority-Driven Differential Expert Caching.

Kexin Li, Wenkan Huang, Qinggang Wang, Long Zheng, Xiaofei Liao, Hai Jin, Jingling Xue

Browse the full SC paper archive.