HoPE: A Novel Positional Encoding Without Long-Term Decay for Enhanced Context Awareness and Extrapolation.

Yuhan Chen, Ang Lv, Jian Luan, Bin Wang, Wei Liu

Browse the full ACL paper archive.