Bitnet.cpp: Efficient Edge Inference for Ternary LLMs.

Jinheng Wang, Hansong Zhou, Ting Song, Shijie Cao, Yan Xia, Ting Cao, Jianyu Wei, Shuming Ma, Hongyu Wang, Furu Wei

Browse the full ACL paper archive.