Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow.

Yixuan Mei, Yonghao Zhuang, Xupeng Miao, Juncheng Yang, Zhihao Jia, Rashmi Vinayak

Browse the full ASPLOS paper archive.