Mixture of Weight-shared Heterogeneous Group Attention Experts for Dynamic Token-wise KV Optimization.

Guanghui Song, Dongping Liao, Yiren Zhao, Kejiang Ye, Chengzhong Xu, Xitong Gao

Browse the full EMNLP paper archive.