Transformers Learn Nonlinear Features In Context: Nonconvex Mean-field Dynamics on the Attention Landscape.

Juno Kim, Taiji Suzuki

Browse the full ICML paper archive.