Sebastian Ruder
Publication record assembled from the DBLP archive of ranked conferences.
Papers indexed
73
Venues
11
Active years
2016–2026
Best venue rank
A*
Where they publish
Papers
73 indexed papers, newest first.
| Year | Venue | Title | Authors |
|---|---|---|---|
| 2026 | ACL | The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs. | Piotr Nawrot, Jianing Li, Renjie Huang, Sebastian Ruder, Kelly Marchisio, Edoardo M. Ponti |
| 2026 | ACL | Parallel-SFT: Improving Zero-Shot Cross-Programming-Language Transfer for Code RL. | Zhaofeng Wu, Shiqi Wang, Boya Peng, Anuj Kumar Goyal, Melanie Kambadur, Sebastian Ruder, Yoon Kim, Chloe Bi |
| 2025 | ACL | M-RewardBench: Evaluating Reward Models in Multilingual Settings. | Srishti Gureja, Lester James Validad Miranda, Shayekh Bin Islam, Rishabh Maheshwary, Drishti Sharma, Gusti Triandi Winata, Nathan Lambert, Sebastian Ruder, Sara Hooker, Marzieh Fadaee |
| 2025 | ACL | Arbiters of Ambivalence: Challenges of using LLMs in No-Consensus tasks. | Bhaktipriya Radharapu, Manon Revel, Megan Ung, Sebastian Ruder, Adina Williams |
| 2025 | ACL | AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic. | Nathaniel Romney Robinson, Shahd Abdelmoneim, Kelly Marchisio, Sebastian Ruder |
| 2025 | ACL | Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation. | Shivalika Singh, Angelika Romanou, Clmentine Fourrier, David Ifeoluwa Adelani, Jian Gang Ngui, Daniel Vila-Suero, Peerat Limkonchotiwat, Kelly Marchisio, Wei Qi Leong, Yosephine Susanto, Raymond Ng, Shayne Longpre, Sebastian Ruder, Wei-Yin Ko, Antoine Bosselut, Alice Oh, Andr F. T. Martins, Leshem Choshen, Daphne Ippolito, Enzo Ferrante, Marzieh Fadaee, Beyza Ermis, Sara Hooker |
| 2024 | ACL | Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning. | Shivalika Singh, Freddie Vargus, Daniel D'souza, Brje Karlsson, Abinaya Mahendiran, Wei-Yin Ko, Herumb Shandilya, Jay Patel, Deividas Mataciunas, Laura O'Mahony, Mike Zhang, Ramith Hettiarachchi, Joseph Wilson, Marina Machado, Luisa Souza Moura, Dominik Krzeminski, Hakimeh Fadaei, Irem Ergn, Ifeoma Okoh, Aisha Alaagib, Oshan Mudannayake, Zaid Alyafeai, Minh Vu Chien, Sebastian Ruder, Surya Guthikonda, Emad A. Alghamdi, Sebastian Gehrmann, Niklas Muennighoff, Max Bartolo, Julia Kreutzer, Ahmet stn, Marzieh Fadaee, Sara Hooker |
| 2024 | COLING | Connecting Language Technologies with Rich, Diverse Data Sources Covering Thousands of Languages. | Daan van Esch, Sandy Ritchie, Sebastian Ruder, Julia Kreutzer, Clara Rivera, Ishank Saxena, Isaac Caswell |
| 2024 | EMNLP | SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages. | Holy Lovenia, Rahmad Mahendra, Salsabil Maulana Akbar, Lester James V. Miranda, Jennifer Santoso, Elyanah Aco, Akhdan Fadhilah, Jonibek Mansurov, Joseph Marvin Imperial, Onno Kampman, Joel Ruben Antony Moniz, Muhammad Ravi Shulthan Habibi, Frederikus Hudi, Jann Railey Montalan, Ryan Hadiwijaya, Joanito Agili Lopo, William Nixon, Brje Karlsson, James Jaya, Ryandito Diandaru, Yuze Gao, Patrick Amadeus Irawan, Bin Wang, Jan Christian Blaise Cruz, Chenxi Whitehouse, Ivan Halim Parmonangan, Maria Khelli, Wenyu Zhang, Lucky Susanto, Reynard Adha Ryanda, Sonny Lazuardi Hermawan, Dan John Velasco, Muhammad Dehan Al Kautsar, Willy Fitra Hendria, Yasmin Moslem, Noah Flynn, Muhammad Farid Adilazuarda, Haochen Li, Johanes Lee, R. Damanhuri, Shuo Sun, Muhammad Reza Qorib, Amirbek Djanibekov, Wei Qi Leong, Quyet V. Do, Niklas Muennighoff, Tanrada Pansuwan, Ilham Firdausi Putra, Yan Xu, Ngee Tai Chia, Ayu Purwarianti, Sebastian Ruder, William-Chandra Tjhi, Peerat Limkonchotiwat, Alham Fikri Aji, Sedrick Keh, Genta Indra Winata, Ruochen Zhang, Fajri Koto, Zheng Xin Yong, Samuel Cahyawijaya |
| 2024 | EMNLP | How Does Quantization Affect Multilingual LLMs? | Kelly Marchisio, Saurabh Dash, Hongyu Chen, Dennis Aumiller, Ahmet stn, Sara Hooker, Sebastian Ruder |
| 2024 | EMNLP | Understanding and Mitigating Language Confusion in LLMs. | Kelly Marchisio, Wei-Yin Ko, Alexandre Berard, Tho Dehaze, Sebastian Ruder |
| 2024 | EMNLP | LLM See, LLM Do: Leveraging Active Inheritance to Target Non-Differentiable Objectives. | Lusa Shimabucoro, Sebastian Ruder, Julia Kreutzer, Marzieh Fadaee, Sara Hooker |
| 2024 | NAACL | BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer. | Akari Asai, Sneha Kudugunta, Xinyan Yu, Terra Blevins, Hila Gonen, Machel Reid, Yulia Tsvetkov, Sebastian Ruder, Hannaneh Hajishirzi |
| 2023 | ACL | NusaCrowd: Open Source Initiative for Indonesian NLP Resources. | Samuel Cahyawijaya, Holy Lovenia, Alham Fikri Aji, Genta Indra Winata, Bryan Wilie, Fajri Koto, Rahmad Mahendra, Christian Wibisono, Ade Romadhony, Karissa Vincentio, Jennifer Santoso, David Moeljadi, Cahya Wirawan, Frederikus Hudi, Muhammad Satrio Wicaksono, Ivan Halim Parmonangan, Ika Alfina, Ilham Firdausi Putra, Samsul Rahmadani, Yulianti Oenang, Ali Akbar Septiandri, James Jaya, Kaustubh D. Dhole, Arie Ardiyanti Suryani, Rifki Afina Putri, Dan Su, Keith Stevens, Made Nindyatama Nityasya, Muhammad Farid Adilazuarda, Ryan Hadiwijaya, Ryandito Diandaru, Tiezheng Yu, Vito Ghifari, Wenliang Dai, Yan Xu, Dyah Damapuspita, Haryo Akbarianto Wibowo, Cuk Tho, Ichwanul Muslim Karo Karo, Tirana Fatyanosa, Ziwei Ji, Graham Neubig, Timothy Baldwin, Sebastian Ruder, Pascale Fung, Herry Sujaini, Sakriani Sakti, Ayu Purwarianti |
| 2023 | ACL | Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features. | Ester Hlavnova, Sebastian Ruder |
| 2023 | EACL | Evaluating the Diversity, Equity, and Inclusion of NLP Technology: A Case Study for Indian Languages. | Simran Khanuja, Sebastian Ruder, Partha Talukdar |
| 2023 | EMNLP | TaTA: A Multilingual Table-to-Text Dataset for African Languages. | Sebastian Gehrmann, Sebastian Ruder, Vitaly Nikolaev, Jan A. Botha, Michael Chavinda, Ankur P. Parikh, Clara Rivera |
| 2023 | EMNLP | AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languages. | Shamsuddeen Hassan Muhammad, Idris Abdulmumin, Abinew Ali Ayele, Nedjma Ousidhoum, David Ifeoluwa Adelani, Seid Muhie Yimam, Ibrahim Said Ahmad, Meriem Beloucif, Saif M. Mohammad, Sebastian Ruder, Oumaima Hourrane, Alpio Jorge, Pavel Brazdil, Felermino Drio Mrio Antnio Ali, Davis David, Salomey Osei, Bello Shehu Bello, Falalu Ibrahim Lawan, Tajuddeen Gwadabe, Samuel Rutunda, Tadesse Destaw Belay, Wendimu Baye Messelle, Hailu Beshada Balcha, Sisay Adugna Chala, Hagos Tesfahun Gebremichael, Bernard Opoku, Stephen Arthur |
| 2023 | EMNLP | Evaluating and Modeling Attribution for Cross-Lingual Question Answering. | Benjamin Muller, John Wieting, Jonathan H. Clark, Tom Kwiatkowski, Sebastian Ruder, Livio Soares, Roee Aharoni, Jonathan Herzig, Xinyi Wang |
| 2023 | EMNLP | Cross-lingual Open-Retrieval Question Answering for African Languages. | Odunayo Ogundepo, Tajuddeen Gwadabe, Clara Rivera, Jonathan H. Clark, Sebastian Ruder, David Ifeoluwa Adelani, Bonaventure Dossou, Abdou Aziz Diop, Claytone Sikasote, Gilles Hacheme, Happy Buzaaba, Ignatius Ezeani, Rooweither Mabuya, Salomey Osei, Chris Emezue, Albert Kahira, Shamsuddeen Hassan Muhammad, Akintunde Oladipo, Abraham Toluwase Owodunni, Atnafu Lambebo Tonja, Iyanuoluwa Shode, Akari Asai, Aremu Anuoluwapo, Ayodele Awokoya, Bernard Opoku, Chiamaka Chukwuneke, Christine Mwase, Clemencia Siro, Stephen Arthur, Tunde Ajayi, Verrah Otiende, Andre Niyongabo Rubungo, Boyd Sinkala, Daniel A. Ajisafe, Emeka Onwuegbuzia, Falalu Ibrahim Lawan, Ibrahim Said Ahmad, Jesujoba O. Alabi, Chinedu E. Mbonu, Mofetoluwa Adeyemi, Mofya Phiri, Orevaoghene Ahia, Ruqayya Nasir Iro, Sonia Adhiambo |
| 2023 | EMNLP | mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations. | Jonas Pfeiffer, Francesco Piccinno, Massimo Nicosia, Xinyi Wang, Machel Reid, Sebastian Ruder |
| 2023 | EMNLP | Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning. | Clifton Poth, Hannah Sterz, Indraneil Paul, Sukannya Purkayastha, Leon Englnder, Timo Imhof, Ivan Vulic, Sebastian Ruder, Iryna Gurevych, Jonas Pfeiffer |
| 2023 | EMNLP | Romanization-based Large-scale Adaptation of Multilingual Language Models. | Sukannya Purkayastha, Sebastian Ruder, Jonas Pfeiffer, Iryna Gurevych, Ivan Vulic |
| 2023 | EMNLP | XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages. | Sebastian Ruder, Jonathan H. Clark, Alexander Gutkin, Mihir Kale, Min Ma, Massimo Nicosia, Shruti Rijhwani, Parker Riley, Jean Michel A. Sarr, Xinyi Wang, John Wieting, Nitish Gupta, Anna Katanova, Christo Kirov, Dana L. Dickinson, Brian Roark, Bidisha Samanta, Connie Tao, David Ifeoluwa Adelani, Vera Axelrod, Isaac Caswell, Colin Cherry, Dan Garrette, R. Reeve Ingle, Melvin Johnson, Dmitry Panteleev, Partha Talukdar |
| 2023 | ICLR | Language models are multilingual chain-of-thought reasoners. | Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, Jason Wei |
| 2022 | ACL | One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia. | Alham Fikri Aji, Genta Indra Winata, Fajri Koto, Samuel Cahyawijaya, Ade Romadhony, Rahmad Mahendra, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Timothy Baldwin, Jey Han Lau, Sebastian Ruder |
| 2022 | ACL | Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold. | Sebastian Ruder, Ivan Vulic, Anders Sgaard |
| 2022 | ACL | Memorisation versus Generalisation in Pre-trained Language Models. | Michael Tnzer, Sebastian Ruder, Marek Rei |
| 2022 | ACL | Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation. | Xinyi Wang, Sebastian Ruder, Graham Neubig |
| 2022 | ACL | FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding. | Yanan Zheng, Jing Zhou, Yujie Qian, Ming Ding, Chonghua Liao, Li Jian, Ruslan Salakhutdinov, Jie Tang, Sebastian Ruder, Zhilin Yang |
| 2022 | EMNLP | MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition. | David Ifeoluwa Adelani, Graham Neubig, Sebastian Ruder, Shruti Rijhwani, Michael Beukman, Chester Palen-Michel, Constantine Lignos, Jesujoba O. Alabi, Shamsuddeen Hassan Muhammad, Peter Nabende, Cheikh M. Bamba Dione, Andiswa Bukula, Rooweither Mabuya, Bonaventure F. P. Dossou, Blessing K. Sibanda, Happy Buzaaba, Jonathan Mukiibi, Godson Kalipe, Derguene Mbaye, Amelia V. Taylor, Fatoumata Ouoba Kabore, Chris Chinenye Emezue, Aremu Anuoluwapo, Perez Ogayo, Catherine Gitau, Edwin Munkoh-Buabeng, Victoire Memdjokam Koagne, Allahsera Auguste Tapo, Tebogo Macucwa, Vukosi Marivate, Elvis Mboning, Tajuddeen Gwadabe, Tosin P. Adewumi, Orevaoghene Ahia, Joyce Nakatumba-Nabende, Neo L. Mokono, Ignatius Ezeani, Chiamaka Chukwuneke, Mofetoluwa Adeyemi, Gilles Hacheme, Idris Abdulmumin, Odunayo Ogundepo, Oreen Yousuf, Tatiana Moteu Ngoli, Dietrich Klakow |
| 2022 | EMNLP | Modular and Parameter-Efficient Fine-Tuning for NLP Models. | Sebastian Ruder, Jonas Pfeiffer, Ivan Vulic |
| 2022 | EMNLP | Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer. | Ahmet stn, Arianna Bisazza, Gosse Bouma, Gertjan van Noord, Sebastian Ruder |
| 2022 | ICLR | ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning. | Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q. Tran, Dara Bahri, Jianmo Ni, Jai Prakash Gupta, Kai Hui, Sebastian Ruder, Donald Metzler |
| 2022 | ICLR | Charformer: Fast Character Transformers via Gradient-based Subword Tokenization. | Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Prakash Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler |
| 2022 | Interspeech | XTREME-S: Evaluating Cross-lingual Speech Representations. | Alexis Conneau, Ankur Bapna, Yu Zhang, Min Ma, Patrick von Platen, Anton Lozhkov, Colin Cherry, Ye Jia, Clara Rivera, Mihir Kale, Daan van Esch, Vera Axelrod, Simran Khanuja, Jonathan H. Clark, Orhan Firat, Michael Auli, Sebastian Ruder, Jason Riesa, Melvin Johnson |
| 2022 | LREC | Writing System and Speaker Metadata for 2, 800+ Language Varieties. | Daan van Esch, Tamar Lucassen, Sebastian Ruder, Isaac Caswell, Clara Rivera |
| 2021 | AAAI | Analogy Training Multilingual Encoders. | Nicolas Garneau, Mareike Hartmann, Anders Sandholm, Sebastian Ruder, Ivan Vulic, Anders Sgaard |
| 2021 | ACL | Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks. | Rabeeh Karimi Mahabadi, Sebastian Ruder, Mostafa Dehghani, James Henderson |
| 2021 | ACL | How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models. | Phillip Rust, Jonas Pfeiffer, Ivan Vulic, Sebastian Ruder, Iryna Gurevych |
| 2021 | EMNLP | MAD-G: Multilingual Adapter Generation for Efficient Cross-Lingual Transfer. | Alan Ansell, Edoardo Maria Ponti, Jonas Pfeiffer, Sebastian Ruder, Goran Glavas, Ivan Vulic, Anna Korhonen |
| 2021 | EMNLP | IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation. | Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, Pascale Fung |
| 2021 | EMNLP | UNKs Everywhere: Adapting Multilingual Language Models to New Scripts. | Jonas Pfeiffer, Ivan Vulic, Iryna Gurevych, Sebastian Ruder |
| 2021 | EMNLP | XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. | Sebastian Ruder, Noah Constant, Jan A. Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Dan Garrette, Graham Neubig, Melvin Johnson |
| 2021 | EMNLP | Multi-Domain Multilingual Question Answering. | Sebastian Ruder, Avi Sil |
| 2021 | EMNLP | Efficient Test Time Adapter Ensembling for Low-resource Language Varieties. | Xinyi Wang, Yulia Tsvetkov, Sebastian Ruder, Graham Neubig |
| 2021 | ICLR | Rethinking Embedding Coupling in Pre-trained Language Models. | Hyung Won Chung, Thibault Fvry, Henry Tsai, Melvin Johnson, Sebastian Ruder |
| 2021 | ICLR | Long Range Arena : A Benchmark for Efficient Transformers. | Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler |
| 2021 | NAACL | Multi-view Subword Regularization. | Xinyi Wang, Sebastian Ruder, Graham Neubig |
| 2020 | ACL | On the Cross-lingual Transferability of Monolingual Representations. | Mikel Artetxe, Sebastian Ruder, Dani Yogatama |
| 2020 | ACL | A Call for More Rigor in Unsupervised Cross-lingual Learning. | Mikel Artetxe, Sebastian Ruder, Dani Yogatama, Gorka Labaka, Eneko Agirre |
| 2020 | COLING | Morphologically Aware Word-Level Translation. | Paula Czarnowska, Sebastian Ruder, Ryan Cotterell, Ann A. Copestake |
| 2020 | EMNLP | AxCell: Automatic Extraction of Results from Machine Learning Papers. | Marcin Kardas, Piotr Czapla, Pontus Stenetorp, Sebastian Ruder, Sebastian Riedel, Ross Taylor, Robert Stojnic |
| 2020 | EMNLP | AdapterHub: A Framework for Adapting Transformers. | Jonas Pfeiffer, Andreas Rckl, Clifton Poth, Aishwarya Kamath, Ivan Vulic, Sebastian Ruder, Kyunghyun Cho, Iryna Gurevych |
| 2020 | EMNLP | MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer. | Jonas Pfeiffer, Ivan Vulic, Iryna Gurevych, Sebastian Ruder |
| 2020 | EMNLP | Are All Good Word Vector Spaces Isomorphic? | Ivan Vulic, Sebastian Ruder, Anders Sgaard |
| 2020 | ICML | XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation. | Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson |
| 2019 | AAAI | Latent Multi-Task Architecture Learning. | Sebastian Ruder, Joachim Bingel, Isabelle Augenstein, Anders Sgaard |
| 2019 | AAAI | A Hierarchical Multi-Task Approach for Learning Embeddings from Semantic Tasks. | Victor Sanh, Thomas Wolf, Sebastian Ruder |
| 2019 | ACL | How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptions. | Goran Glavas, Robert Litschko, Sebastian Ruder, Ivan Vulic |
| 2019 | ACL | Unsupervised Cross-Lingual Representation Learning. | Sebastian Ruder, Anders Sgaard, Ivan Vulic |
| 2019 | EMNLP | Don't Forget the Long Tail! A Comprehensive Analysis of Morphological Generalization in Bilingual Lexicon Induction. | Paula Czarnowska, Sebastian Ruder, Edouard Grave, Ryan Cotterell, Ann A. Copestake |
| 2019 | EMNLP | MultiFiT: Efficient Multi-lingual Language Model Fine-tuning. | Julian Eisenschlos, Sebastian Ruder, Piotr Czapla, Marcin Kardas, Sylvain Gugger, Jeremy Howard |
| 2019 | NAACL | Transfer Learning in Natural Language Processing. | Sebastian Ruder, Matthew E. Peters, Swabha Swayamdipta, Thomas Wolf |
| 2018 | ACL | Strong Baselines for Neural Semi-Supervised Learning under Domain Shift. | Sebastian Ruder, Barbara Plank |
| 2018 | ACL | Universal Language Model Fine-tuning for Text Classification. | Jeremy Howard, Sebastian Ruder |
| 2018 | ACL | On the Limitations of Unsupervised Bilingual Dictionary Induction. | Anders Sgaard, Sebastian Ruder, Ivan Vulic |
| 2018 | CoNLL | Generalizing Procrustes Analysis for Better Bilingual Dictionary Induction. | Yova Kementchedjhieva, Sebastian Ruder, Ryan Cotterell, Anders Sgaard |
| 2018 | EMNLP | A Discriminative Latent-Variable Model for Bilingual Lexicon Induction. | Sebastian Ruder, Ryan Cotterell, Yova Kementchedjhieva, Anders Sgaard |
| 2018 | NAACL | Multi-Task Learning of Pairwise Sequence Classification Tasks over Disparate Label Spaces. | Isabelle Augenstein, Sebastian Ruder, Anders Sgaard |
| 2018 | NAACL | 360° Stance Detection. | Sebastian Ruder, John Glover, Afshin Mehrabani, Parsa Ghaffari |
| 2017 | EMNLP | Learning to select data for transfer learning with Bayesian Optimization. | Sebastian Ruder, Barbara Plank |
| 2016 | EMNLP | A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis. | Sebastian Ruder, Parsa Ghaffari, John G. Breslin |