Ouroboros: Generating Longer Drafts Phrase by Phrase for Faster Speculative Decoding.

Weilin Zhao, Yuxiang Huang, Xu Han, Wang Xu, Chaojun Xiao, Xinrong Zhang, Yewei Fang, Kaihuo Zhang, Zhiyuan Liu, Maosong Sun

Browse the full EMNLP paper archive.