Cauchy: A Cost-Efficient LLM Serving System through Adaptive Heterogeneous Deployment.

Yihui Zhang, Han Shen, Renyu Yang, Di Tian, Yuxi Luo, Menghao Zhang, Li Li, Chunming Hu, Tianyu Wo, Chengru Song, Jin Ouyang

Browse the full CLOUD paper archive.