Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization.

Jiantong Jiang, Peiyu Yang, Rui Zhang, Feng Liu

Browse the full ACL paper archive.