Over-Tokenized Transformer: Vocabulary is Generally Worth Scaling.

Hongzhi Huang, Defa Zhu, Banggu Wu, Yutao Zeng, Ya Wang, Qiyang Min, Xun Zhou

Browse the full ICML paper archive.