Transformers with Learnable Activation Functions.

Haishuo Fang, Ji-Ung Lee, Nafise Sadat Moosavi, Iryna Gurevych

Browse the full EACL paper archive.