LogitSpec: Accelerating Retrieval-based Speculative Decoding via Next Next Token Speculation.

Tianyu Liu, Qitan Lv, Hao Li, Xing Gao, Xiao Sun, Xiaoyan Sun

Browse the full ACL paper archive.