SpecCache: Speculative KV Cache Reuse for Efficient RAG Serving.

Zijian Wen, Tao Zhang, Shuangwu Chen, Shenghao Ye, Yu Guo, Qirui Chen, Jingxian Shuai, Yunpeng Hou, Huasen He, Jian Yang

Browse the full ACL paper archive.