Fast Large Language Model Collaborative Decoding via Speculation.
Jiale Fu, Yuchu Jiang, Junkai Chen, Jiaming Fan, Xin Geng, Xu Yang
Browse the full ICML paper archive.
Jiale Fu, Yuchu Jiang, Junkai Chen, Jiaming Fan, Xin Geng, Xu Yang
Browse the full ICML paper archive.