SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting.

Jiaming Xu, Jiayi Pan, Yongkang Zhou, Siming Chen, Jinhao Li, Yaoxiu Lian, Junyi Wu, Guohao Dai

Browse the full ISCA paper archive.