Finite State Automata Inside Transformers with Chain-of-Thought: A Mechanistic Study on State Tracking.

Yifan Zhang, Wenyu Du, Dongming Jin, Jie Fu, Zhi Jin

Browse the full ACL paper archive.