Scaling Laws for Fine-Grained Mixture of Experts.

Jan Ludziejewski, Jakub Krajewski, Kamil Adamczewski, Maciej Piro, Michal Krutul, Szymon Antoniak, Kamil Ciebiera, Krystian Krl, Tomasz Odrzygzdz, Piotr Sankowski, Marek Cygan, Sebastian Jaszczur

Browse the full ICML paper archive.