Falcon: Faster and Parallel Inference of Large Language Models Through Enhanced Semi-Autoregressive Drafting and Custom-Designed Decoding Tree.

Xiangxiang Gao, Weisheng Xie, Yiwei Xiang, Feng Ji

Browse the full AAAI paper archive.