Initialization of Large Language Models via Reparameterization to Mitigate Loss Spikes.

Kosuke Nishida, Kyosuke Nishida, Kuniko Saito

Browse the full EMNLP paper archive.