Provable Benefit of Orthogonal Initialization in Optimizing Deep Linear Networks.

Wei Hu, Lechao Xiao, Jeffrey Pennington

Browse the full ICLR paper archive.