Bandwidth Characterization of DeepSpeed on Distributed Large Language Model Training.

Bagus Hanindhito, Bhavesh Patel, Lizy K. John

Browse the full ISPASS paper archive.