High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws.

Muhammed Emrullah Ildiz, Halil Alperen Gozeten, Ege Onur Taga, Marco Mondelli, Samet Oymak

Browse the full ICLR paper archive.