SpotServe: Serving Generative Large Language Models on Preemptible Instances.

Xupeng Miao, Chunan Shi, Jiangfei Duan, Xiaoli Xi, Dahua Lin, Bin Cui, Zhihao Jia

Browse the full ASPLOS paper archive.