KVmix: Gradient-Based Layer Importance-Aware Mixed-Precision Quantization for KV Cache.

Fei Li, Song Liu, Weiguo Wu, Shiqiang Nie, Jinyu Wang

Browse the full AAAI paper archive.