Shift Parallelism: Low-Latency, High-Throughput LLM Inference for Dynamic Workloads.

Mert Hidayetoglu, Aurick Qiao, Michael Wyatt, Jeff Rasley, Yuxiong He, Samyam Rajbhandari

Browse the full ASPLOS paper archive.