Dynamic-Width Speculative Beam Decoding for LLM Inference.

Zongyue Qin, Zifan He, Neha Prakriya, Jason Cong, Yizhou Sun

Browse the full AAAI paper archive.