Mixture of Hidden-Dimensions: Not All Hidden-States' Dimensions are Needed in Transformer.

Yilong Chen, Junyuan Shang, Zhenyu Zhang, Jiawei Sheng, Tingwen Liu, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang

Browse the full ICML paper archive.