FLYING SERVING: On-the-Fly Parallelism Switching for Large Language Model Serving.

Shouwei Gao, Junqi Yin, Feiyi Wang, Wenqian Dong

Browse the full ICS paper archive.