Scaling LLM Speculative Decoding: Non-Autoregressive Forecasting in Large-Batch Scenarios.

Luohe Shi, Zuchao Li, Lefei Zhang, Baoyuan Qi, Guoming Liu, Hai Zhao

Browse the full AAAI paper archive.