ReZero is all you need: fast convergence at large depth.

Thomas Bachlechner, Bodhisattwa Prasad Majumder, Huanru Henry Mao, Gary Cottrell, Julian J. McAuley

Browse the full UAI paper archive.