Randomized Positional Encodings Boost Length Generalization of Transformers.

Anian Ruoss, Grgoire Deltang, Tim Genewein, Jordi Grau-Moya, Rbert Csords, Mehdi Bennani, Shane Legg, Joel Veness

Browse the full ACL paper archive.