TaylorShift: Shifting the Complexity of Self-attention from Squared to Linear (and Back) Using Taylor-Softmax.

Tobias Christian Nauen, Sebastian Palacio, Andreas Dengel

Browse the full ICPR paper archive.