Demystifying the Communication Characteristics for Distributed Transformer Models.

Quentin Anthony, Benjamin Michalowicz, Jacob Hatef, Lang Xu, Mustafa Abdul Jabbar, Aamir Shafi, Hari Subramoni, Dhabaleswar K. Panda

Browse the full HOTI paper archive.