"My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models.
Xinpeng Wang, Bolei Ma, Chengzhi Hu, Leon Weber-Genzel, Paul Rttger, Frauke Kreuter, Dirk Hovy, Barbara Plank
Browse the full ACL paper archive.