nGPT: Normalized Transformer with Representation Learning on the Hypersphere.

Ilya Loshchilov, Cheng-Ping Hsieh, Simeng Sun, Boris Ginsburg

Browse the full ICLR paper archive.