Mell: Memory-Efficient Large Language Model Serving via Multi-GPU KV Cache Management.

Qianli Liu, Zicong Hong, Peng Li, Fahao Chen, Song Guo

Browse the full INFOCOM paper archive.