When Attention Sink Emerges in Language Models: An Empirical View.

Xiangming Gu, Tianyu Pang, Chao Du, Qian Liu, Fengzhuo Zhang, Cunxiao Du, Ye Wang, Min Lin

Browse the full ICLR paper archive.