A Systematic Study of Cross-Layer KV Sharing for Efficient LLM Inference.

You Wu, Haoyi Wu, Kewei Tu

Browse the full NAACL paper archive.