Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT.

James Lee-Thorp, Joshua Ainslie

Browse the full EMNLP paper archive.