Taming the Titans: A Survey of Efficient LLM Inference Serving.

Ranran Zhen, Juntao Li, Yixin Ji, Zhenlin Yang, Tong Liu, Qingrong Xia, Xinyu Duan, Zhefeng Wang, Baoxing Huai, Min Zhang

Browse the full INLG paper archive.