Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent.

William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah A. Smith

Browse the full EMNLP paper archive.