LightSeq2: Accelerated Training for Transformer-Based Models on GPUs.

Xiaohui Wang, Yang Wei, Ying Xiong, Guyue Huang, Xian Qian, Yufei Ding, Mingxuan Wang, Lei Li

Browse the full SC paper archive.