Knowledge Distillation from Bert in Pre-Training and Fine-Tuning for Polyphone Disambiguation.

Hao Sun, Xu Tan, Jun-Wei Gan, Sheng Zhao, Dongxu Han, Hongzhi Liu, Tao Qin, Tie-Yan Liu

Browse the full ASRU paper archive.