Improving Transformer Optimization Through Better Initialization.

Xiao Shi Huang, Felipe Prez, Jimmy Ba, Maksims Volkovs

Browse the full ICML paper archive.