Mega: Moving Average Equipped Gated Attention.

Xuezhe Ma, Chunting Zhou, Xiang Kong, Junxian He, Liangke Gui, Graham Neubig, Jonathan May, Luke Zettlemoyer

Browse the full ICLR paper archive.