Sliding-Window Merging for Compacting Patch-Redundant Layers in LLMs.
Xuan Ding, Rui Sun, Yunjian Zhang, Xiu Yan, Yueqi Zhou, Kaihao Huang, Suzhong Fu, Angelica I. Avils-Rivero, Chuanlong Xie, Yao Zhu
Browse the full AAAI paper archive.
Xuan Ding, Rui Sun, Yunjian Zhang, Xiu Yan, Yueqi Zhou, Kaihao Huang, Suzhong Fu, Angelica I. Avils-Rivero, Chuanlong Xie, Yao Zhu
Browse the full AAAI paper archive.