Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity.

Michael R. Metel, Peng Lu, Boxing Chen, Mehdi Rezagholizadeh, Ivan Kobyzev

Browse the full EMNLP paper archive.