"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization.

Eldar Kurtic, Alexandre Noll Marques, Shubhra Pandit, Mark Kurtz, Dan Alistarh

Browse the full ACL paper archive.