FastKV: Decoupling of Context Reduction and KV Cache Compression for Prefill-Decoding Acceleration.

Dongwon Jo, Jiwon Song, Yulhwa Kim, Jae-Joon Kim

Browse the full ACL paper archive.