Joint MoE Scaling Laws: Mixture of Experts Can Be Memory Efficient.

Jan Ludziejewski, Maciej Piro, Jakub Krajewski, Maciej Stefaniak, Michal Krutul, Jan Malasnicki, Marek Cygan, Piotr Sankowski, Kamil Adamczewski, Piotr Milos, Sebastian Jaszczur

Browse the full ICML paper archive.