Distributed LLM Serving on Consumer-Grade GPUs by Reconciling Computation and Communication.

Lewei Jin, Kui Zhang, Yongqi Chen, Yifan Zhuo, Renjie Li, Yi Gao, Bowei Yang, Zhengong Cai, Wei Dong

Browse the full EMNLP paper archive.