Chameleon: Adaptive Caching and Scheduling for Many-Adapter LLM Inference Environments.
Nikoleta Iliakopoulou, Jovan Stojkovic, Chloe Alverti, Tianyin Xu, Hubertus Franke, Josep Torrellas
Browse the full MICRO paper archive.
Nikoleta Iliakopoulou, Jovan Stojkovic, Chloe Alverti, Tianyin Xu, Hubertus Franke, Josep Torrellas
Browse the full MICRO paper archive.