How to Set the Learning Rate for Large-Scale Pre-training?

Yunhua Zhou, Shuhao Xing, Junhao Huang, Xipeng Qiu, Qipeng Guo

Browse the full ACL paper archive.