How Much Self-Attention Do We Need? Trading Attention for Feed-Forward Layers.

Kazuki Irie, Alexander Gerstenberger, Ralf Schlter, Hermann Ney

Browse the full ICASSP paper archive.