FLRC: Fine-grained Low-Rank Compressor for Efficient LLM Inference.

Yu-Chen Lu, Chong-Yan Chen, Chi-Chih Chang, Yu-Fang Hu, Kai-Chiang Wu

Browse the full EMNLP paper archive.