Cost-Optimal Grouped-Query Attention for Long-Context Modeling.

Yingfa Chen, Yutong Wu, Chenyang Song, Zhen Leng Thai, Xingyu Shen, Xu Han, Zhiyuan Liu, Maosong Sun

Browse the full EMNLP paper archive.