Omnia: Efficient RAG Serving through Speculative Scheduling.

Rongtian Fu, Shigang Li, Youxuan Xu, Tong Wu, Zhi Ma, Jinliang Shi

Browse the full HPDC paper archive.