LBPE: Long-token-first Tokenization to Improve Large Language Models.
Haoran Lian, Yizhe Xiong, Zijia Lin, Jianwei Niu, Shasha Mo, Hui Chen, Peng Liu, Guiguang Ding
Browse the full ICASSP paper archive.
Haoran Lian, Yizhe Xiong, Zijia Lin, Jianwei Niu, Shasha Mo, Hui Chen, Peng Liu, Guiguang Ding
Browse the full ICASSP paper archive.