A Graph-Based Methodology for Dynamic KV-Cache Compression in Transformer Inference.

Neermita Bhattacharya, Shyam Sathvik, Abhishek Yadav, Ayush Dixit, Binod Kumar

Browse the full ISCAS paper archive.