Efficient Batch Processing for Private Cloud LLM Inference: Modeling and Performance Comparison.

Hiroki Nakai, Yoshiaki Inoue, Tetsuya Takine

Browse the full GLOBECOM paper archive.