The Orthogonality of Weight Vectors: The Key Characteristics of Normalization and Residual Connections.

Zhixing Lu, Yuanyuan Sun, Zhihao Yang, Qin Zhou, Hongfei Lin

Browse the full IJCAI paper archive.