Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging.

Pierre Ablin, Angelos Katharopoulos, Skyler Seto, David Grangier

Browse the full ICML paper archive.