LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation.

Zican Dong, Junyi Li, Jinhao Jiang, Mingyu Xu, Xin Zhao, Bingning Wang, Weipeng Chen

Browse the full ACL paper archive.