BitDecoding: Unlocking Tensor Cores for Long-Context LLMs with Low-Bit KV Cache.

Dayou Du, Shijie Cao, Jianyi Cheng, Luo Mai, Ting Cao, Mao Yang

Browse the full HPCA paper archive.