Profiling-Free Mixed-Precision Quantization for MoE LLMs via Fuzzy Rule Interpolation.

Huachen Qi, Ruiyu Zhuo, Bowen Shi, Xiang Chang, Fei Chao, Changjing Shang, Qiang Shen

Browse the full ACL paper archive.