Divergent Token Metrics: Measuring degradation to prune away LLM components - and optimize quantization.
Bjrn Deiseroth, Max Meuer, Nikolas Gritsch, Constantin Eichenberg, Patrick Schramowski, Matthias Aenmacher, Kristian Kersting
Browse the full NAACL paper archive.