MiniKV: Pushing the Limits of 2-Bit KV Cache via Compression and System Co-Design for Efficient Long Context Inference.

Akshat Sharma, Hangliang Ding, Jianping Li, Neel Dani, Minjia Zhang

Browse the full ACL paper archive.