Bag of Tricks for Sparse Mixture-of-Experts: A Benchmark Across Reasoning, Efficiency, and Safety.

Mufan Qiu, Zheyu Shen, Pingzhi Li, Ang Li, Tianlong Chen

Browse the full EMNLP paper archive.