HShare: Fast LLM Decoding by Hierarchical Key-Value Sharing.

Huaijin Wu, Lianqiang Li, Hantao Huang, Tu Yi, Jihang Zhang, Minghui Yu, Junchi Yan

Browse the full ICLR paper archive.