RL with KL penalties is better viewed as Bayesian inference.

Tomasz Korbak, Ethan Perez, Christopher L. Buckley

Browse the full EMNLP paper archive.