Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training.
Zheheng Luo, Xin Zhang, Xiao Liu, Haoling Li, Yeyun Gong, Qi Chen, Peng Cheng
Browse the full ACL paper archive.
Zheheng Luo, Xin Zhang, Xiao Liu, Haoling Li, Yeyun Gong, Qi Chen, Peng Cheng
Browse the full ACL paper archive.