Multiplexed Heterogeneous LLM Serving via Stage-Aligned Parallelism.

Tao Luo, Kelvin K. W. Ng, Zhen Ping Khor, Sidharth Sankhe, Boon Thau Loo, Vincent Liu

Browse the full CLOUD paper archive.