SYMI: Efficient Mixture-of-Experts Training via Model and Optimizer State Decoupling.

Athinagoras Skiadopoulos, Mark Zhao, Swapnil Gandhi, Thomas Norrie, Shrijeet Mukherjee, Christos Kozyrakis

Browse the full NSDI paper archive.