Relative Positional Encoding for Transformers with Linear Complexity.

Antoine Liutkus, Ondrej Cfka, Shih-Lun Wu, Umut Simsekli, Yi-Hsuan Yang, Gal Richard

Browse the full ICML paper archive.