Efficient Fine-Grained Gpu Performance Modeling for Distributed Deep Learning of Llm.

Biyao Zhang, Mingkai Zheng, Debargha Ganguly, Xuecen Zhang, Vikash Singh, Vipin Chaudhary, Zhao Zhang

Browse the full HiPC paper archive.