SwiftSpec: Disaggregated Speculative Decoding and Fused Kernels for Low-Latency LLM Inference.

Ziyi Zhang, Ziheng Jiang, Chengquan Jiang, Menghan Yu, Size Zheng, Haibin Lin, Xin Liu, Henry Hoffmann

Browse the full ASPLOS paper archive.