The Role of Sparsity for Length Generalization in LLMs.

Noah Golowich, Samy Jelassi, David Brandfonbrener, Sham M. Kakade, Eran Malach

Browse the full ICML paper archive.