Accelerating Iterative Retrieval-augmented Language Model Serving with Speculation.

Zhihao Zhang, Alan Zhu, Lijie Yang, Yihua Xu, Lanting Li, Phitchaya Mangpo Phothilimthana, Zhihao Jia

Browse the full ICML paper archive.