Breaking ReLU Barrier: Generalized MoEfication for Dense Pretrained Models.

Jaeseong Lee, Seung-won Hwang, Wonpyo Park, Mingi Ji

Browse the full EMNLP paper archive.