u-μP: The Unit-Scaled Maximal Update Parametrization.

Charlie Blake, Constantin Eichenberg, Josef Dean, Lukas Balles, Luke Yuri Prince, Bjrn Deiseroth, Andrs Felipe Cruz-Salinas, Carlo Luschi, Samuel Weinbach, Douglas Orr

Browse the full ICLR paper archive.