High-Throughput Non-uniformly Quantized 3-bit LLM Inference.

YuAng Chen, Wenqi Zeng, Jeffrey Xu Yu

Browse the full PPoPP paper archive.