ExeGPT: Constraint-Aware Resource Scheduling for LLM Inference.

Hyungjun Oh, Kihong Kim, Jaemin Kim, Sungkyun Kim, Junyeol Lee, Du-Seong Chang, Jiwon Seo

Browse the full ASPLOS paper archive.