Scaling Large Language Model Training on Frontier with Low-Bandwidth Partitioning.

Lang Xu, Quentin Anthony, Jacob Hatef, Aamir Shafi, Hari Subramoni, Dhabaleswar K. Panda

Browse the full HiPC paper archive.