InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management.

Wonbeom Lee, Jungi Lee, Junghwan Seo, Jaewoong Sim

Browse the full OSDI paper archive.