BanditSpec: Adaptive Speculative Decoding via Bandit Algorithms.

Yunlong Hou, Fengzhuo Zhang, Cunxiao Du, Xuan Zhang, Jiachun Pan, Tianyu Pang, Chao Du, Vincent Y. F. Tan, Zhuoran Yang

Browse the full ICML paper archive.