AdaServe: Accelerating Multi-SLO LLM Serving with SLO-Customized Speculative Decoding.

Zikun Li, Zhuofu Chen, Remi Delacourt, Gabriele Oliaro, Zeyu Wang, Qinghan Chen, Shuhuai Lin, April Yang, Zhihao Zhang, Zhuoming Chen, Yi-Hsiang Lai, Xinhao Cheng, Xupeng Miao, Zhihao Jia

Browse the full EuroSys paper archive.