Amphista: Bi-directional Multi-head Decoding for Accelerating LLM Inference.

Zeping Li, Xinlong Yang, Ziheng Gao, Ji Liu, Guanchen Li, Zhuang Liu, Dong Li, Jinzhang Peng, Lu Tian, Emad Barsoum

Browse the full NAACL paper archive.