Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases.

Michael Y. Hu, Jackson Petty, Chuan Shi, William Merrill, Tal Linzen

Browse the full ACL paper archive.