Paella: Low-latency Model Serving with Software-defined GPU Scheduling.

Kelvin K. W. Ng, Henri Maxime Demoulin, Vincent Liu

Browse the full SOSP paper archive.