Kelle: Co-design KV Caching and eDRAM for Efficient LLM Serving in Edge Computing.

Tianhua Xia, Sai Qian Zhang

Browse the full MICRO paper archive.