Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning.

Libin Zhu, Chaoyue Liu, Adityanarayanan Radhakrishnan, Mikhail Belkin

Browse the full ICML paper archive.