On the Analysis and Distillation of Emergent Outlier Properties in Pre-trained Language Models.

Tianyang Zhao, Kunwar Yashraj Singh, Srikar Appalaraju, Peng Tang, Ying Nian Wu, Li Erran Li

Browse the full NAACL paper archive.