Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders.

Minsoo Kim, Sihwa Lee, Sukjin Hong, Du-Seong Chang, Jungwook Choi

Browse the full EMNLP paper archive.