SemCache: Semantic-Aware Cache Sharing for Efficient Multi-User LoRA-Adapted LLM Inference at the Edge.

Tao Ren, Yiming Yao, Zheyuan Hu, Jianwei Niu

Browse the full INFOCOM paper archive.