KVPR: Efficient LLM Inference with I/O-Aware KV Cache Partial Recomputation.

Chaoyi Jiang, Lei Gao, Hossein Entezari Zarch, Murali Annavaram

Browse the full ACL paper archive.