MossNet: Mixture of State-Space Experts is a Multi-Head Attention.

Shikhar Tuli, James Seale Smith, Haris Jeelani, Chi-Heng Lin, Abhishek Patel, Vasili Ramanishka, Yen-Chang Hsu, Hongxia Jin

Browse the full IJCNLP paper archive.