Tender: Accelerating Large Language Models via Tensor Decomposition and Runtime Requantization.

Jungi Lee, Wonbeom Lee, Jaewoong Sim

Browse the full ISCA paper archive.