FIER: Fine-Grained and Efficient KV Cache Retrieval for Long-context LLM Inference.

Dongwei Wang, Zijie Liu, Song Wang, Yuxin Ren, Jianing Deng, Jingtong Hu, Tianlong Chen, Huanrui Yang

Browse the full EMNLP paper archive.