Fuzzy Speculative Decoding for a Tunable Accuracy-Runtime Tradeoff.

Maximilian Holsman, Yukun Huang, Bhuwan Dhingra

Browse the full ACL paper archive.