Position IDs Matter: An Enhanced Position Layout for Efficient Context Compression in Large Language Models.

Runsong Zhao, Xin Liu, Xinyu Liu, Pengcheng Huang, Chunyang Xiao, Tong Xiao, JingBo Zhu

Browse the full EMNLP paper archive.