Edge Intelligence Optimization for Large Language Model Inference with Batching and Quantization.

Xinyuan Zhang, Jiang Liu, Zehui Xiong, Yudong Huang, Gaochang Xie, Ran Zhang

Browse the full WCNC paper archive.