SSDTrain: An Activation Offloading Framework to SSDs for Faster Large Language Model Training.

Kun Wu, Jeongmin Brian Park, Xiaofan Zhang, Mert Hidayetoglu, Vikram Sharma Mailthody, Sitao Huang, Steven S. Lumetta, Wen-Mei Hwu

Browse the full DAC paper archive.