Gradient Weight-normalized Low-rank Projection for Efficient LLM Training.
Jia-Hong Huang, Yixian Shen, Hongyi Zhu, Stevan Rudinac, Evangelos Kanoulas
Browse the full AAAI paper archive.
Jia-Hong Huang, Yixian Shen, Hongyi Zhu, Stevan Rudinac, Evangelos Kanoulas
Browse the full AAAI paper archive.