Lyapunov-Guided KV Cache Control for Multi-tenant Edge LLM Servicing.

Haishuo Yu, Winston K. G. Seah, Gang Xu, Xiaodong Xu

Browse the full EuroPar paper archive.