Untie the Knots: An Efficient Data Augmentation Strategy for Long-Context Pre-Training in Language Models.

Junfeng Tian, Da Zheng, Yang Chen, Rui Wang, Colin Zhang, Debing Zhang

Browse the full ACL paper archive.