Delving into Variance Transmission and Normalization: Shift of Average Gradient Makes the Network Collapse.

Yuxiang Liu, Jidong Ge, Chuanyi Li, Jie Gui

Browse the full AAAI paper archive.