Themis: a network bandwidth-aware collective scheduling policy for distributed training of DL models.

Saeed Rashidi, William Won, Sudarshan Srinivasan, Srinivas Sridharan, Tushar Krishna

Browse the full ISCA paper archive.