SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models.

Vithursan Thangarasa, Abhay Gupta, William Marshall, Tianda Li, Kevin Leong, Dennis DeCoste, Sean Lie, Shreyas Saxena

Browse the full UAI paper archive.