Gumiho: A Hybrid Architecture to Prioritize Early Tokens in Speculative Decoding.

Jinze Li, Yixing Xu, Haiduo Huang, Xuanwu Yin, Dong Li, Edith C. H. Ngai, Emad Barsoum

Browse the full ICML paper archive.