Lazy Batching: An SLA-aware Batching System for Cloud Machine Learning Inference.

Yujeong Choi, Yunseong Kim, Minsoo Rhu

Browse the full HPCA paper archive.