KVSwap: Disk-aware KV Cache Offloading for Long-Context On-device Inference.

Huawei Zhang, Chunwei Xia, Zheng Wang

Browse the full Mobisys paper archive.