MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models.

Elias Frantar, Roberto L. Castro, Jiale Chen, Torsten Hoefler, Dan Alistarh

Browse the full PPoPP paper archive.