Training Dynamics Underlying Language Model Scaling Laws: Loss Deceleration and Zero-Sum Learning.

Andrei Mircea, Supriyo Chakraborty, Nima Chitsazan, Irina Rish, Ekaterina Lobacheva

Browse the full ACL paper archive.