WAGES: Workload-Aware GPU Sharing System for Energy-Efficient Serverless LLM Serving.

Tianyu Wang, Gourav Rattihalli, Aditya Dhakal, Xulong Tang, Dejan S. Milojicic

Browse the full SC paper archive.