MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving.

Jiangfei Duan, Runyu Lu, Haojie Duanmu, Xiuhong Li, Xingcheng Zhang, Dahua Lin, Ion Stoica, Hao Zhang

Browse the full ICML paper archive.