CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation.

Ziyue Liu, Ruijie Zhang, Zhengyang Wang, Mingsong Yan, Zi Yang, Paul D. Hovland, Bogdan Nicolae, Franck Cappello, Sui Tang, Zheng Zhang

Browse the full EMNLP paper archive.