Towards Optimal Preemptive GPU Time-Sharing for Edge Model Serving.

Zhengxu Xia, Yitian Hao, Jun Duan, Chen Wang, Junchen Jiang

Browse the full Middleware paper archive.