Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN.

Pengxiang Li, Lu Yin, Shiwei Liu

Browse the full ICLR paper archive.