Klotski: Efficient Mixture-of-Expert Inference via Expert-Aware Multi-Batch Pipeline.

Zhiyuan Fang, Yuegui Huang, Zicong Hong, Yufeng Lyu, Wuhui Chen, Yue Yu, Fan Yu, Zibin Zheng

Browse the full ASPLOS paper archive.