Towards Being Parameter-Efficient: A Stratified Sparsely Activated Transformer with Dynamic Capacity.

Haoran Xu, Maha Elbayad, Kenton Murray, Jean Maillard, Vedanuj Goswami

Browse the full EMNLP paper archive.