Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving.

Yinwei Dai, Rui Pan, Anand P. Iyer, Kai Li, Ravi Netravali

Browse the full SOSP paper archive.