DynamoServe: A Distributed Tiered Memory System for Multi-tenant LLM Serving.

Diman Zad Tootaghaj, Khaled Diab, Bob Lantz, Hanjiang Wu, K. K. Ramakrishnan, Md Ashfaqur Rahaman, Ryan Stutsman, Puneet Sharma, Tushar Krishna

Browse the full SIGCOMM paper archive.