LycheeCluster: Efficient Long-Context Inference with Structure-Aware Chunking and Hierarchical KV Indexing.

Dongfang Li, Zixuan Liu, Gang Lin, Baotian Hu, Min Zhang

Browse the full ACL paper archive.