Synthesizer: Rethinking Self-Attention for Transformer Models.

Yi Tay, Dara Bahri, Donald Metzler, Da-Cheng Juan, Zhe Zhao, Che Zheng

Browse the full ICML paper archive.