SpecExtend: A Drop-in Enhancement for Speculative Decoding of Long Sequences.

Jungyoub Cha, Hyunjong Kim, Sungzoon Cho

Browse the full ACL paper archive.