A Simple and Effective Positional Encoding for Transformers.

Pu-Chin Chen, Henry Tsai, Srinadh Bhojanapalli, Hyung Won Chung, Yin-Wen Chang, Chun-Sung Ferng

Browse the full EMNLP paper archive.