Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer.

Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc V. Le, Geoffrey E. Hinton, Jeff Dean

Browse the full ICLR paper archive.