Learning to Grow Pretrained Models for Efficient Transformer Training.

Peihao Wang, Rameswar Panda, Lucas Torroba Hennigen, Philip Greengard, Leonid Karlinsky, Rogrio Feris, David Daniel Cox, Zhangyang Wang, Yoon Kim

Browse the full ICLR paper archive.