Folding Attention: Memory and Power Optimization for On-Device Transformer-Based Streaming Speech Recognition.
Yang Li, Liangzhen Lai, Yuan Shangguan, Forrest N. Iandola, Zhaoheng Ni, Ernie Chang, Yangyang Shi, Vikas Chandra
Browse the full ICASSP paper archive.