KUNSERVE: Parameter-centric Memory Management for Efficient Memory Overloading Handling in LLM Serving.

Rongxin Cheng, Yuxin Lai, Xingda Wei, Rong Chen, Haibo Chen

Browse the full EuroSys paper archive.