FR-Spec: Accelerating Large-Vocabulary Language Models via Frequency-Ranked Speculative Sampling.

Weilin Zhao, Tengyu Pan, Xu Han, Yudi Zhang, Sun Ao, Yuxiang Huang, Kaihuo Zhang, Weilun Zhao, Yuxuan Li, Jie Zhou, Hao Zhou, Jianyong Wang, Maosong Sun, Zhiyuan Liu

Browse the full ACL paper archive.