FlexLLM: Flexible and Cost-Efficient LLM Serving with Heterogeneous GPUs.
Kihyun Kim, Jinwoo Kim, James J. Kim, Dong Li, Youngjae Kim
Browse the full MASCOTS paper archive.
Kihyun Kim, Jinwoo Kim, James J. Kim, Dong Li, Youngjae Kim
Browse the full MASCOTS paper archive.