MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs.

Shiyi Cao, Shu Liu, Tyler Griggs, Peter Schafhalter, Xiaoxuan Liu, Ying Sheng, Joseph E. Gonzalez, Matei Zaharia, Ion Stoica

Browse the full ASPLOS paper archive.