KVCache Cache in the Wild: Characterizing and Optimizing KVCache Cache at a Large Cloud Provider.

Jiahao Wang, Jinbo Han, Xingda Wei, Sijie Shen, Dingyan Zhang, Chenguang Fang, Rong Chen, Wenyuan Yu, Haibo Chen

Browse the full USENIX paper archive.