Oneiros: KV Cache Optimization through Parameter Remapping for Multi-tenant LLM Serving.

Ruihao Li, Shagnik Pal, Vineeth Narayan Pullu, Prasoon Sinha, Jeeho Ryoo, Lizy K. John, Neeraja J. Yadwadkar

Browse the full CLOUD paper archive.