Optimizing Large Language Model Training Using FP4 Quantization.

Ruizhe Wang, Yeyun Gong, Xiao Liu, Guoshuai Zhao, Ziyue Yang, Baining Guo, Zheng-Jun Zha, Peng Cheng

Browse the full ICML paper archive.