Benchmarking Post-Training Quantization of Large Language Models under Microscaling Floating Point Formats.

Manyi Zhang, Ji-Fu Li, Zhongao Sun, Haoli Bai, Hui-Ling Zhen, Zhenhua Dong, Xianzhi Yu

Browse the full ACL paper archive.