EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees.

Yuhui Li, Fangyun Wei, Chao Zhang, Hongyang Zhang

Browse the full EMNLP paper archive.