LISLLM: Long Context Inference of Large Language Models with Short KV Cache.

Tielong Liu, Gang Li, Zeyu Zhu, Zitao Mo, Xingting Yao, Jian Cheng

Browse the full ICPADS paper archive.