ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models.

Iman Mirzadeh, Keivan Alizadeh-Vahid, Sachin Mehta, Carlo C. del Mundo, Oncel Tuzel, Golnoosh Samei, Mohammad Rastegari, Mehrdad Farajtabar

Browse the full ICLR paper archive.