Transformer-Based Resource and Stage-Aware Scheduling for Model-Parallel LLM Inference.

Rami Naeem, Tengis Buyantogtokh, Hamada Rizk, Tatsuya Amano, Hirozumi Yamaguchi

Browse the full ICDCN paper archive.