CoSine: Enhancing LLM Serving via Collaborative and Decoupled Speculative Inference.

Luyao Gao, Jianchun Liu, Xichong Zhang, Guoju Gao, Yunming Liao

Browse the full INFOCOM paper archive.