Toppings: CPU-Assisted, Rank-Aware Adapter Serving for LLM Inference.

Suyi Li, Hanfeng Lu, Tianyuan Wu, Minchen Yu, Qizhen Weng, Xusheng Chen, Yizhou Shan, Binhang Yuan, Wei Wang

Browse the full USENIX paper archive.