AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models.

Yichun Yin, Cheng Chen, Lifeng Shang, Xin Jiang, Xiao Chen, Qun Liu

Browse the full ACL paper archive.