IC-Cache: Efficient Large Language Model Serving via In-context Caching.

Yifan Yu, Yu Gan, Nikhil Sarda, Lillian Tsai, Jiaming Shen, Yanqi Zhou, Arvind Krishnamurthy, Fan Lai, Hank Levy, David E. Culler

Browse the full SOSP paper archive.