PowerNorm: Rethinking Batch Normalization in Transformers.

Sheng Shen, Zhewei Yao, Amir Gholami, Michael W. Mahoney, Kurt Keutzer

Browse the full ICML paper archive.