Statistical Advantages of Perturbing Cosine Router in Mixture of Experts.

Huy Nguyen, Pedram Akbarian, Huyen Trang Pham, Thien Trang Nguyen Vu, Shujian Zhang, Nhat Ho

Browse the full ICLR paper archive.