Enabling Memory-Disaggregated Cloud Infrastructure for LLMs: An Adaptive CXL-based KV Cache Scheduling Approach.

Ke Wang, Yaqian Zhao, Yaqiang Zhang, Fei Gao, Guangyuan Xu

Browse the full INFOCOM paper archive.