DEPT: Decoupled Embeddings for Pre-training Language Models.

Alex Iacob, Lorenzo Sani, Meghdad Kurmanji, William F. Shen, Xinchi Qiu, Dongqi Cai, Yan Gao, Nicholas Donald Lane

Browse the full ICLR paper archive.