Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalization.
Stanislaw Jastrzebski, Devansh Arpit, Oliver strand, Giancarlo Kerg, Huan Wang, Caiming Xiong, Richard Socher, Kyunghyun Cho, Krzysztof J. Geras
Browse the full ICML paper archive.