Why Are Positional Encodings Nonessential for Deep Autoregressive Transformers? A Petroglyph Revisited.

Kazuki Irie

Browse the full ACL paper archive.