Gating Dropout: Communication-efficient Regularization for Sparsely Activated Transformers.

Rui Liu, Young Jin Kim, Alexandre Muzio, Hany Hassan

Browse the full ICML paper archive.