STEP: Staged Parameter-Efficient Pre-training for Large Language Models.

Kazuki Yano, Takumi Ito, Jun Suzuki

Browse the full NAACL paper archive.