Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models.

Siqi Wang, Zhengyu Chen, Bei Li, Keqing He, Min Zhang, Jingang Wang

Browse the full EMNLP paper archive.