Half-S: Halving the Scale for Near-Lossless 4-Bit LLM Training.

Jinyang Du, Ruihao Gong, Linghan Ai, Zining Wang, Yunke Peng, Yao Wang, Lei Yan, Xuefei Wang, Yaoyuan Wang, Jinyang Guo, Dahua Lin, Xianglong Liu

Browse the full ACL paper archive.