Fine-Grained State Sharding and Communication Pipelining for Partially Sharded Data Parallelism.

Weimin Li, Yuzhong Sun, Lin Meng

Browse the full ICPADS paper archive.