Deploy Efficient Large Language Model Distributed Inference Pipeline for Heterogeneous GPUs.

Junyang Zhang, Jiahui Hou, Bowen Zhang, Xiang-Yang Li

Browse the full IWQoS paper archive.