Increasing Learning Efficiency of Self-Attention Networks through Direct Position Interactions, Learnable Temperature, and Convoluted Attention.

Philipp Dufter, Martin Schmitt, Hinrich Schtze

Browse the full COLING paper archive.