Length Generalization of Causal Transformers without Position Encoding.

Jie Wang, Tao Ji, Yuanbin Wu, Hang Yan, Tao Gui, Qi Zhang, Xuanjing Huang, Xiaoling Wang

Browse the full ACL paper archive.