Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models.

Keisuke Kamahori, Tian Tang, Yile Gu, Kan Zhu, Baris Kasikci

Browse the full ICLR paper archive.