Aegaeon: Effective GPU Pooling for Concurrent LLM Serving on the Market.

Yuxing Xiang, Xue Li, Kun Qian, Yufan Yang, Diwen Zhu, Wenyuan Yu, Ennan Zhai, Xuanzhe Liu, Xin Jin, Jingren Zhou

Browse the full SOSP paper archive.