CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending.

Shiyi Zhu, Jing Ye, Wei Jiang, Siqiao Xue, Qi Zhang, Yifan Wu, Jianguo Li

Browse the full ACL paper archive.