PAME: precision-aware multi-exit DNN serving for reducing latencies of batched inferences.
Shulai Zhang, Weihao Cui, Quan Chen, Zhengnian Zhang, Yue Guan, Jingwen Leng, Chao Li, Minyi Guo
Browse the full ICS paper archive.
Shulai Zhang, Weihao Cui, Quan Chen, Zhengnian Zhang, Yue Guan, Jingwen Leng, Chao Li, Minyi Guo
Browse the full ICS paper archive.