DistillSpec: Improving Speculative Decoding via Knowledge Distillation.

Yongchao Zhou, Kaifeng Lyu, Ankit Singh Rawat, Aditya Krishna Menon, Afshin Rostamizadeh, Sanjiv Kumar, Jean-Franois Kagy, Rishabh Agarwal

Browse the full ICLR paper archive.