JoMA: Demystifying Multilayer Transformers via Joint Dynamics of MLP and Attention.

Yuandong Tian, Yiping Wang, Zhenyu Zhang, Beidi Chen, Simon Shaolei Du

Browse the full ICLR paper archive.