Found in the middle: Calibrating Positional Attention Bias Improves Long Context Utilization.

Cheng-Yu Hsieh, Yung-Sung Chuang, Chun-Liang Li, Zifeng Wang, Long T. Le, Abhishek Kumar, James R. Glass, Alexander Ratner, Chen-Yu Lee, Ranjay Krishna, Tomas Pfister

Browse the full ACL paper archive.