LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism.

Bingyang Wu, Shengyu Liu, Yinmin Zhong, Peng Sun, Xuanzhe Liu, Xin Jin

Browse the full SOSP paper archive.