Deputy: Accelerating Large Language Model Inference with Dynamic Low-Rank Substitution.

Yuhua Zhou, Shichao Weng, Changhai Zhou, Yuhan Wu, Qian Qiao, Jun Gao, Fei Yang, Aimin Pan

Browse the full ACL paper archive.