A length adaptive algorithm-hardware co-design of transformer on FPGA through sparse attention and dynamic pipelining.

Hongwu Peng, Shaoyi Huang, Shiyang Chen, Bingbing Li, Tong Geng, Ang Li, Weiwen Jiang, Wujie Wen, Jinbo Bi, Hang Liu, Caiwen Ding

Browse the full DAC paper archive.