KV Cache Reuse for Elastic LLM Inference on Edge Devices.

Peishuo Wang, Zhenzhe Zheng, Xiaoyao Huang, Jie Wu, Fan Wu, Guihai Chen

Browse the full ICDCS paper archive.