Make It Long, Keep It Fast: End-to-End 10k-Sequence Modeling at Billion Scale on Douyin.

Lin Guan, Jia-Qi Yang, Zhishan Zhao, Beichuan Zhang, Bo Sun, Xuanyuan Luo, Jinan Ni, Xiaowen Li, Yuhang Qi, Zhifang Fan, Hangyu Wang, Qiwei Chen, Yi Cheng, Feng Zhang, Xiao Yang

Browse the full WWW paper archive.