MoE-Lens: Towards the Hardware Limit of High-Throughput MoE LLM Serving Under Resource Constraints.

Yichao Yuan, Lin Ma, Nishil Talati

Browse the full HPDC paper archive.