HACK: Homomorphic Acceleration via Compression of the Key-Value Cache for Disaggregated LLM Inference.
Zeyu Zhang, Haiying Shen, Shay Vargaftik, Ran Ben Basat, Michael Mitzenmacher, Minlan Yu
Browse the full SIGCOMM paper archive.
Zeyu Zhang, Haiying Shen, Shay Vargaftik, Ran Ben Basat, Michael Mitzenmacher, Minlan Yu
Browse the full SIGCOMM paper archive.