Rotate, Clip, and Partition: Towards W2A4KV4 Quantization by Integrating Rotation and Learnable Non-uniform Quantizer.

Euntae Choi, Sumin Song, Woosang Lim, Sungjoo Yoo

Browse the full EMNLP paper archive.