In-Context Linear Regression Demystified: Training Dynamics and Mechanistic Interpretability of Multi-Head Softmax Attention.

Jianliang He, Xintian Pan, Siyu Chen, Zhuoran Yang

Browse the full ICML paper archive.