LLM-FP4: 4-Bit Floating-Point Quantized Transformers.

Shih-Yang Liu, Zechun Liu, Xijie Huang, Pingcheng Dong, Kwang-Ting Cheng

Browse the full EMNLP paper archive.