From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories, and Applications.
Ajay Kumar Jaiswal, Yifan Wang, Lu Yin, Shiwei Liu, Runjin Chen, Jiawei Zhao, Ananth Grama, Yuandong Tian, Zhangyang Wang
Browse the full ICML paper archive.