EMS-SD: Efficient Multi-sample Speculative Decoding for Accelerating Large Language Models.

Yunsheng Ni, Chuanjian Liu, Yehui Tang, Kai Han, Yunhe Wang

Browse the full NAACL paper archive.