Lowering the Pre-training Tax for Gradient-based Subset Training: A Lightweight Distributed Pre-Training Toolkit.

Yeonju Ro, Zhangyang Wang, Vijay Chidambaram, Aditya Akella

Browse the full ICML paper archive.