RT-LM: Uncertainty-Aware Resource Management for Real-Time Inference of Language Models.

Yufei Li, Zexin Li, Wei Yang, Cong Liu

Browse the full RTSS paper archive.