Multi-Branch Self-Drafting for LLM Inference Acceleration.
Zipeng Gao, Qingrong Xia, Tong Xu, Xinyu Duan, Zhi Zheng, Zhefeng Wang, Enhong Chen
Browse the full AAAI paper archive.
Zipeng Gao, Qingrong Xia, Tong Xu, Xinyu Duan, Zhi Zheng, Zhefeng Wang, Enhong Chen
Browse the full AAAI paper archive.