RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation.

Md. Akmal Haidar, Nithin Anchuri, Mehdi Rezagholizadeh, Abbas Ghaddar, Philippe Langlais, Pascal Poupart

Browse the full NAACL paper archive.