LaTune: Lightweight and Adaptive Configuration Tuning for LLM Inference on Edge Devices.

Siqi Zhong, Mugeng Liu, Haiyang Shen, Chongyang Pan, Yun Ma

Browse the full WWW paper archive.