Ecco: Improving Memory Bandwidth and Capacity for LLMs via Entropy-Aware Cache Compression.

Feng Cheng, Cong Guo, Chiyue Wei, Junyao Zhang, Changchun Zhou, Edward Hanson, Jiaqi Zhang, Xiaoxiao Liu, Hai Li, Yiran Chen

Browse the full ISCA paper archive.