Dynamical Isometry and a Mean Field Theory of RNNs: Gating Enables Signal Propagation in Recurrent Neural Networks.

Minmin Chen, Jeffrey Pennington, Samuel S. Schoenholz

Browse the full ICML paper archive.