Exploring the Limits of Model Compression in LLMs: A Knowledge Distillation Study on QA Tasks.

Joyeeta Datta, Niclas Doll, Qusai Ramadan, Zeyd Boukhers

Browse the full SIGdial paper archive.