| 2026 | ACL | Cell-Based Representation of Relational Binding in Language Models. | Qin Dai, Benjamin Heinzerling, Kentaro Inui |
| 2025 | ACL | Library-Like Behavior In Language Models is Enhanced by Self-Referencing Causal Cycles. | Munachiso Nwadike, Zangir Iklassov, Toluwani Aremu, Tatsuya Hiraoka, Benjamin Heinzerling, Velibor Bojkovic, Hilal AlQuabeh, Martin Takc, Kentaro Inui |
| 2025 | ACL | On Entity Identification in Language Models. | Masaki Sakata, Benjamin Heinzerling, Sho Yokoi, Takumi Ito, Kentaro Inui |
| 2025 | EMNLP | How a Bilingual LM Becomes Bilingual: Tracing Internal Representations with Sparse Autoencoders. | Tatsuro Inaba, Go Kamoda, Kentaro Inui, Masaru Isonuma, Yusuke Miyao, Yohei Oseki, Yu Takagi, Benjamin Heinzerling |
| 2025 | IJCNLP | Can Language Models Handle a Non-Gregorian Calendar? The Case of the Japanese wareki. | Mutsumi Sasaki, Go Kamoda, Ryosuke Takahashi, Kosuke Sato, Kentaro Inui, Keisuke Sakaguchi, Benjamin Heinzerling |
| 2025 | NAACL | The Geometry of Numerical Reasoning: Language Models Compare Numeric Properties in Linear Subspaces. | Ahmed Oumar El-Shangiti, Tatsuya Hiraoka, Hilal AlQuabeh, Benjamin Heinzerling, Kentaro Inui |
| 2025 | NAACL | Weight-based Analysis of Detokenization in Language Models: Understanding the First Stage of Inference Without Inference. | Go Kamoda, Benjamin Heinzerling, Tatsuro Inaba, Keito Kudo, Keisuke Sakaguchi, Kentaro Inui |
| 2024 | ACL | Monotonic Representation of Numeric Attributes in Language Models. | Benjamin Heinzerling, Kentaro Inui |
| 2024 | EMNLP | Representational Analysis of Binding in Language Models. | Qin Dai, Benjamin Heinzerling, Kentaro Inui |
| 2023 | ACL | Can LMs Store and Retrieve 1-to-N Relational Knowledge? | Haruki Nagasawa, Benjamin Heinzerling, Kazuma Kokuta, Kentaro Inui |
| 2023 | EACL | Prompting for explanations improves Adversarial NLI. Is this true? Yes it is true because it weakens superficial cues. | Pride Kavumba, Ana Brassard, Benjamin Heinzerling, Kentaro Inui |
| 2023 | EMNLP | Test-time Augmentation for Factual Probing. | Go Kamoda, Benjamin Heinzerling, Keisuke Sakaguchi, Kentaro Inui |
| 2022 | EMNLP | Cross-stitching Text and Knowledge Graph Encoders for Distantly Supervised Relation Extraction. | Qin Dai, Benjamin Heinzerling, Kentaro Inui |
| 2022 | LREC | COPA-SSE: Semi-structured Explanations for Commonsense Reasoning. | Ana Brassard, Benjamin Heinzerling, Pride Kavumba, Kentaro Inui |
| 2021 | EACL | Language Models as Knowledge Bases: On Entity Representations, Storage Capacity, and Paraphrased Queries. | Benjamin Heinzerling, Kentaro Inui |
| 2021 | NAACL | Learning to Learn to be Right for the Right Reasons. | Pride Kavumba, Benjamin Heinzerling, Ana Brassard, Kentaro Inui |
| 2019 | ACL | Sequence Tagging with Contextual and Non-Contextual Subword Representations: A Multilingual Evaluation. | Benjamin Heinzerling, Michael Strube |
| 2019 | CoNLL | On the Importance of Subword Information for Morphological Tasks in Truly Low-Resource Languages. | Yi Zhu, Benjamin Heinzerling, Ivan Vulic, Michael Strube, Roi Reichart, Anna Korhonen |
| 2018 | LREC | BPEmb: Tokenization-free Pre-trained Subword Embeddings in 275 Languages. | Benjamin Heinzerling, Michael Strube |
| 2017 | EACL | Trust, but Verify! Better Entity Linking through Automatic Verification. | Benjamin Heinzerling, Michael Strube, Chin-Yew Lin |
| 2017 | EMNLP | Revisiting Selectional Preferences for Coreference Resolution. | Benjamin Heinzerling, Nafise Sadat Moosavi, Michael Strube |
| 2015 | ACL | Visual Error Analysis for Entity Linking. | Benjamin Heinzerling, Michael Strube |