AdamS: Momentum Itself Can Be A Normalizer for LLM Pretraining and Post-training.

Huishuai Zhang, Bohan Wang, Luoxin Chen

Browse the full EMNLP paper archive.