Transformer Language Models Handle Word Frequency in Prediction Head.

Goro Kobayashi, Tatsuki Kuribayashi, Sho Yokoi, Kentaro Inui

Browse the full ACL paper archive.