Headless Language Models: Learning without Predicting with Contrastive Weight Tying.

Nathan Godey, ric Villemonte de la Clergerie, Benot Sagot

Browse the full ICLR paper archive.