Characterizing Communication Patterns in Distributed Large Language Model Inference.

Lang Xu, Kaushik Kandadi Suresh, Quentin Anthony, Nawras Alnaasan, Dhabaleswar K. Panda

Browse the full HOTI paper archive.