BranchNorm: Robustly Scaling Extremely Deep Transformers.

Yijin Liu, Xianfeng Zeng, Fandong Meng, Jie Zhou

Browse the full ACL paper archive.