On the Optimization and Generalization of Two-layer Transformers with Sign Gradient Descent.

Bingrui Li, Wei Huang, Andi Han, Zhanpeng Zhou, Taiji Suzuki, Jun Zhu, Jianfei Chen

Browse the full ICLR paper archive.