ZipServ: Fast and Memory-Efficient LLM Inference with Hardware-Aware Lossless Compression.

Ruibo Fan, Xiangrui Yu, Xinglin Pan, Zeyu Li, Weile Luo, Qiang Wang, Wei Wang, Xiaowen Chu

Browse the full ASPLOS paper archive.