Towards Optimal Multi-draft Speculative Decoding.

Zhengmian Hu, Tong Zheng, Vignesh Viswanathan, Ziyi Chen, Ryan A. Rossi, Yihan Wu, Dinesh Manocha, Heng Huang

Browse the full ICLR paper archive.