ServerlessLLM: Low-Latency Serverless Inference for Large Language Models.

Yao Fu, Leyang Xue, Yeqi Huang, Andrei-Octavian Brabete, Dmitrii Ustiugov, Yuvraj Patel, Luo Mai

Browse the full OSDI paper archive.