QIGen: A Kernel Generator for Inference on Nonuniformly Quantized Large Language Models.

Tommaso Pegolotti, Dan Alistarh, Markus Pschel

Browse the full CGO paper archive.