Variable Layerwise Quantization: A Simple and Effective Approach to Quantize LLMs.

Razvan-Gabriel Dumitru, Vikas Yadav, Rishabh Maheshwary, Paul-Ioan Clotan, Sathwik Tejaswi Madhusudhan, Mihai Surdeanu

Browse the full ACL paper archive.