SCOOT: SLO-Oriented Performance Tuning for LLM Inference Engines.

Ke Cheng, Zhi Wang, Wen Hu, Tiannuo Yang, Jianguo Li, Sheng Zhang

Browse the full WWW paper archive.