KVServe: Service-Aware KV Cache Compression for Communication-Efficient Disaggregated LLM Serving.

Zedong Liu, Xinyang Ma, Dejun Luo, Hairui Zhao, Bing Lu, Wenjing Huang, Yida Gu, Xingchen Liu, Zheng Wei, Jinyang Liu, Dingwen Tao, Guangming Tan

Browse the full SIGCOMM paper archive.