Anisotropy Is Inherent to Self-Attention in Transformers.

Nathan Godey, ric Villemonte de la Clergerie, Benot Sagot

Browse the full EACL paper archive.