Optimized Multi-Token Joint Decoding With Auxiliary Model for LLM Inference.

Zongyue Qin, Ziniu Hu, Zifan He, Neha Prakriya, Jason Cong, Yizhou Sun

Browse the full ICLR paper archive.