HeteroSpec: Leveraging Contextual Heterogeneity for Efficient Speculative Decoding.
Siran Liu, Yang Ye, Qianchao Zhu, Zane Cao, Yongchao He
Browse the full ACL paper archive.
Siran Liu, Yang Ye, Qianchao Zhu, Zane Cao, Yongchao He
Browse the full ACL paper archive.