Priority-Based Data Transfer Control for LLM Inference Streaming Leveraging Prompt Importance.

Hiroki Baba, Kenshiro Wada, Kentaro Hayashi, Kenzo Okuda, Naoki Kimishima, Tomonori Takeda

Browse the full NetSoft paper archive.