Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation.

Zhenyu He, Guhao Feng, Shengjie Luo, Kai Yang, Liwei Wang, Jingjing Xu, Zhi Zhang, Hongxia Yang, Di He

Browse the full ICML paper archive.