Poster: PipeLLM: Pipeline LLM Inference on Heterogeneous Devices with Sequence Slicing.

Ruilong Ma, Jingyu Wang, Qi Qi, Xiang Yang, Haifeng Sun, Zirui Zhuang, Jianxin Liao

Browse the full SIGCOMM paper archive.