Taming Transformer Without Using Learning Rate Warmup.

Xianbiao Qi, Yelin He, Jiaquan Ye, Chun-Guang Li, Bojia Zi, Xili Dai, Qin Zou, Rong Xiao

Browse the full ICLR paper archive.