SmartCache: Two-Dimensional KV-Cache Similarity for Efficient Long-Context LLM Decoding.

Chen Shen, Hao Chen, Kaining Hui, Zhixin Zhao, Yang Cheng, Yitao Hu, Sheng Chen, Xiulong Liu, Keqiu Li

Browse the full HPCC paper archive.