Performance Testing and Analysis of Token Generation for LLMs Based on MaaS (Model-as-a-Service).

Yang Cheng, Sisi Qin, Jing Qi, Feng Cao, Dongwei Yan

Browse the full HPCC paper archive.