SPIN: Accelerating Large Language Model Inference with Heterogeneous Speculative Models.

Fahao Chen, Peng Li, Tom H. Luan, Zhou Su, Jing Deng

Browse the full INFOCOM paper archive.