Outlier Dimensions that Disrupt Transformers are Driven by Frequency.

Giovanni Puccetti, Anna Rogers, Aleksandr Drozd, Felice Dell'Orletta

Browse the full EMNLP paper archive.