Towards an Understanding of Stepwise Inference in Transformers: A Synthetic Graph Navigation Model.

Mikail Khona, Maya Okawa, Jan Hula, Rahul Ramesh, Kento Nishi, Robert P. Dick, Ekdeep Singh Lubana, Hidenori Tanaka

Browse the full ICML paper archive.