Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models.

Akhil Kedia, Mohd Abbas Zaidi, Sushil Khyalia, Jungho Jung, Harshith Goka, Haejun Lee

Browse the full ICML paper archive.