Anisotropy is Not Inherent to Transformers.

Anemily Machina, Robert E. Mercer

Browse the full NAACL paper archive.