LayerNorm Induces Recency Bias in Transformer Decoders.

Junu Kim, Xiao Liu, Zhenghao Lin, Lei Ji, Yeyun Gong, Edward Choi

Browse the full ACL paper archive.