Variance Sensitivity Induces Attention Entropy Collapse and Instability in Transformers.

Jonghyun Hong, Sungyoon Lee

Browse the full EMNLP paper archive.