Anda: Unlocking Efficient LLM Inference with a Variable-Length Grouped Activation Data Format.

Chao Fang, Man Shi, Robin Geens, Arne Symons, Zhongfeng Wang, Marian Verhelst

Browse the full HPCA paper archive.