How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers.

Michael Hassid, Hao Peng, Daniel Rotem, Jungo Kasai, Ivan Montero, Noah A. Smith, Roy Schwartz

Browse the full EMNLP paper archive.