MixCE: Training Autoregressive Language Models by Mixing Forward and Reverse Cross-Entropies.

Shiyue Zhang, Shijie Wu, Ozan Irsoy, Steven Lu, Mohit Bansal, Mark Dredze, David S. Rosenberg

Browse the full ACL paper archive.