ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition.

Lu Ye, Ze Tao, Yong Huang, Yang Li

Browse the full ACL paper archive.