Skip to content

Iz Beltagy

Publication record assembled from the DBLP archive of ranked conferences.

Papers indexed

24

Venues

5

Active years

2018–2024

Best venue rank

A*

Where they publish

Papers

24 indexed papers, newest first.

YearVenueTitleAuthors
2024ACLOLMo: Accelerating the Science of Language Models.Dirk Groeneveld, Iz Beltagy, Evan Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi
2024ACLDolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research.Luca Soldaini, Rodney Kinney, Akshita Bhagia, Dustin Schwenk, David Atkinson, Russell Authur, Ben Bogin, Khyathi Raghavi Chandu, Jennifer Dumas, Yanai Elazar, Valentin Hofmann, Ananya Harsh Jha, Sachin Kumar, Li Lucy, Xinxi Lyu, Nathan Lambert, Ian Magnusson, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Abhilasha Ravichander, Kyle Richardson, Zejiang Shen, Emma Strubell, Nishant Subramani, Oyvind Tafjord, Pete Walsh, Luke Zettlemoyer, Noah A. Smith, Hannaneh Hajishirzi, Iz Beltagy, Dirk Groeneveld, Jesse Dodge, Kyle Lo
2024EACLTESS: Text-to-Text Self-Conditioned Simplex Diffusion.Rabeeh Karimi Mahabadi, Hamish Ivison, Jaesung Tae, James Henderson, Iz Beltagy, Matthew E. Peters, Arman Cohan
2023ACLZ-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrations.Xinxi Lyu, Sewon Min, Iz Beltagy, Luke Zettlemoyer, Hannaneh Hajishirzi
2023ACLFiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning.Qinyuan Ye, Iz Beltagy, Matthew E. Peters, Xiang Ren, Hannaneh Hajishirzi
2022ACLZero- and Few-Shot NLP with Pretrained Language Models.Iz Beltagy, Arman Cohan, Robert L. Logan IV, Sewon Min, Sameer Singh
2022ACLPRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization.Wen Xiao, Iz Beltagy, Giuseppe Carenini, Arman Cohan
2022EMNLPWhat Language Model to Train if You Have One Million GPU Hours?Teven Le Scao, Thomas Wang, Daniel Hesslow, Lucile Saulnier, Stas Bekman, M. Saiful Bari, Stella Biderman, Hady Elsahar, Niklas Muennighoff, Jason Phang, Ofir Press, Colin Raffel, Victor Sanh, Sheng Shen, Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, Iz Beltagy
2022EMNLPSciFact-Open: Towards open-domain scientific claim verification.David Wadden, Kyle Lo, Bailey Kuehl, Arman Cohan, Iz Beltagy, Lucy Lu Wang, Hannaneh Hajishirzi
2022EMNLPContinued Pretraining for Better Zero- and Few-Shot Promptability.Zhaofeng Wu, Robert L. Logan IV, Pete Walsh, Akshita Bhagia, Dirk Groeneveld, Sameer Singh, Iz Beltagy
2022ICMLStaged Training for Transformer Language Models.Sheng Shen, Pete Walsh, Kurt Keutzer, Jesse Dodge, Matthew E. Peters, Iz Beltagy
2022ICMLWhat Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization?Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, Colin Raffel
2022NAACLFew-Shot Self-Rationalization with Natural Language Prompts.Ana Marasovic, Iz Beltagy, Doug Downey, Matthew E. Peters
2022NAACLMultiVerS: Improving scientific claim verification with weak supervision and full-document context.David Wadden, Kyle Lo, Lucy Lu Wang, Arman Cohan, Iz Beltagy, Hannaneh Hajishirzi
2021EMNLPCDLM: Cross-Document Language Modeling.Avi Caciularu, Arman Cohan, Iz Beltagy, Matthew E. Peters, Arie Cattan, Ido Dagan
2021EMNLPMS\^2: Multi-Document Summarization of Medical Studies.Jay DeYoung, Iz Beltagy, Madeleine van Zuylen, Bailey Kuehl, Lucy Lu Wang
2021NAACLA Dataset of Information-Seeking Questions and Answers Anchored in Research Papers.Pradeep Dasigi, Kyle Lo, Iz Beltagy, Arman Cohan, Noah A. Smith, Matt Gardner
2020ACLSPECTER: Document-level Representation Learning using Citation-informed Transformers.Arman Cohan, Sergey Feldman, Iz Beltagy, Doug Downey, Daniel S. Weld
2020ACLDon't Stop Pretraining: Adapt Language Models to Domains and Tasks.Suchin Gururangan, Ana Marasovic, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, Noah A. Smith
2020ACLSciREX: A Challenge Dataset for Document-Level Information Extraction.Sarthak Jain, Madeleine van Zuylen, Hannaneh Hajishirzi, Iz Beltagy
2019EMNLPSciBERT: A Pretrained Language Model for Scientific Text.Iz Beltagy, Kyle Lo, Arman Cohan
2019EMNLPPretrained Language Models for Sequential Sentence Classification.Arman Cohan, Iz Beltagy, Daniel King, Bhavana Dalvi, Daniel S. Weld
2019NAACLCombining Distant and Direct Supervision for Neural Relation Extraction.Iz Beltagy, Kyle Lo, Waleed Ammar
2018NAACLConstruction of the Literature Graph in Semantic Scholar.Waleed Ammar, Dirk Groeneveld, Chandra Bhagavatula, Iz Beltagy, Miles Crawford, Doug Downey, Jason Dunkelberger, Ahmed Elgohary, Sergey Feldman, Vu Ha, Rodney Kinney, Sebastian Kohlmeier, Kyle Lo, Tyler Murray, Hsu-Han Ooi, Matthew E. Peters, Joanna Power, Sam Skjonsberg, Lucy Lu Wang, Chris Wilhelm, Zheng Yuan, Madeleine van Zuylen, Oren Etzioni