What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation.

Aaditya K. Singh, Ted Moskovitz, Felix Hill, Stephanie C. Y. Chan, Andrew M. Saxe

Browse the full ICML paper archive.