A Drop-In Solution for On-the-Fly Adaptation of Speculative Decoding in Large Language Models.

Jiesong Liu, Brian Park, Xipeng Shen

Browse the full ACL paper archive.