QuickLLaMA: Query-aware Inference Acceleration for Large Language Models.
Jingyao Li, Han Shi, Sitong Wu, Chuanyang Zheng, Zhenguo Li, Xin Jiang, Hong Xu, Jiaya Jia
Browse the full COLING paper archive.
Jingyao Li, Han Shi, Sitong Wu, Chuanyang Zheng, Zhenguo Li, Xin Jiang, Hong Xu, Jiaya Jia
Browse the full COLING paper archive.