Absolute Position Embedding Learns Sinusoid-like Waves for Attention Based on Relative Position.

Yuji Yamamoto, Takuya Matsuzaki

Browse the full EMNLP paper archive.