Exploring the Feasibility and Performance of Distributed Llm Serving on Consumer-Grade Gpus.

Lewei Jin, Yang Liu, Yongqi Chen, Xiaoqiang Guo, Kui Zhang, Yi Gao, Wei Dong

Browse the full ICDCS paper archive.