SEPARATE: A Simple Low-rank Projection for Gradient Compression in Modern Large-scale Model Training Process.

Hanzhen Zhao, Xingyu Xie, Cong Fang, Zhouchen Lin

Browse the full ICLR paper archive.