Transformers Learn In-Context by Gradient Descent.

Johannes von Oswald, Eyvind Niklasson, Ettore Randazzo, Joo Sacramento, Alexander Mordvintsev, Andrey Zhmoginov, Max Vladymyrov

Browse the full ICML paper archive.