Efficient Long-Range Transformers: You Need to Attend More, but Not Necessarily at Every Layer.

Qingru Zhang, Dhananjay Ram, Cole Hawkins, Sheng Zha, Tuo Zhao

Browse the full EMNLP paper archive.