Transformers Implement Functional Gradient Descent to Learn Non-Linear Functions In Context.

Xiang Cheng, Yuxin Chen, Suvrit Sra

Browse the full ICML paper archive.