Scaled ReLU Matters for Training Vision Transformers.

Pichao Wang, Xue Wang, Hao Luo, Jingkai Zhou, Zhipeng Zhou, Fan Wang, Hao Li, Rong Jin

Browse the full AAAI paper archive.