Boosting the Performance of Tree-Based Speculative Decoding of LLMs on FPGAs.

Tielong Liu, Gang Li, Zitao Mo, Zeyu Zhu, Minnan Pei, Jian Cheng

Browse the full DATE paper archive.