Nick Craswell
Publication record assembled from the DBLP archive of ranked conferences.
Papers indexed
122
Venues
11
Active years
1999–2026
Best venue rank
A*
Where they publish
Papers
122 indexed papers, newest first.
| Year | Venue | Title | Authors |
|---|---|---|---|
| 2026 | SIGIR | Evaluation Validity in Information Retrieval. | Paul Thomas, Nick Craswell, Mark Sanderson, Seth Spielman, Robert Sim, Ryen W. White |
| 2026 | SIGIR | Automating Generation of Long-Form Queries. | Shivani Upadhyay, Daniel Campos, Nandan Thakur, Ronak Pradeep, Nick Craswell, Jimmy Lin |
| 2025 | CIKM | Towards Understanding Bias in Synthetic Data for Evaluation. | Hossein A. Rahmani, Varsha Ramineni, Emine Yilmaz, Nick Craswell, Bhaskar Mitra |
| 2025 | ECIR | Ragnark: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track. | Ronak Pradeep, Nandan Thakur, Sahel Sharifymoghaddam, Eric Zhang, Ryan Nguyen, Daniel Campos, Nick Craswell, Jimmy Lin |
| 2025 | ICTIR | Principles and Guidelines for the Use of LLM Judges. | Laura Dietz, Oleg Zendel, Peter Bailey, Charles L. A. Clarke, Ellese Cotterill, Jeff Dalton, Faegheh Hasibi, Mark Sanderson, Nick Craswell |
| 2025 | ICTIR | A Large-Scale Study of Relevance Assessments with Large Language Models Using UMBRELA. | Shivani Upadhyay, Ronak Pradeep, Nandan Thakur, Daniel Campos, Nick Craswell, Ian Soboroff, Jimmy Lin |
| 2025 | WWW | SynDL: A Large-Scale Synthetic Test Collection for Passage Retrieval. | Hossein A. Rahmani, Xi Wang, Emine Yilmaz, Nick Craswell, Bhaskar Mitra, Paul Thomas |
| 2025 | WWW | JudgeBlender: Ensembling Automatic Relevance Judgments. | Hossein A. Rahmani, Emine Yilmaz, Nick Craswell, Bhaskar Mitra |
| 2025 | SIGIR | The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models. | Ronak Pradeep, Nandan Thakur, Shivani Upadhyay, Daniel Campos, Nick Craswell, Ian Soboroff, Hoa Trang Dang, Jimmy Lin |
| 2025 | SIGIR | LLM4Eval: Large Language Model for Evaluation in IR. | Clemencia Siro, Hossein A. Rahmani, Mohammad Aliannejadi, Nick Craswell, Charles L. A. Clarke, Guglielmo Faggioli, Bhaskar Mitra, Paul Thomas, Emine Yilmaz |
| 2025 | SIGIR | Assessing Support for the TREC 2024 RAG Track: A Large-Scale Comparative Study of LLM and Human Evaluations. | Nandan Thakur, Ronak Pradeep, Shivani Upadhyay, Daniel Campos, Nick Craswell, Ian Soboroff, Hoa Trang Dang, Jimmy Lin |
| 2025 | WSDM | LLM4Eval@WSDM 2025: Large Language Model for Evaluation in Information Retrieval. | Hossein A. Rahmani, Clemencia Siro, Mohammad Aliannejadi, Nick Craswell, Charles L. A. Clarke, Guglielmo Faggioli, Bhaskar Mitra, Paul Thomas, Emine Yilmaz |
| 2024 | ICTIR | Towards Group-aware Search Success. | Haolun Wu, Bhaskar Mitra, Nick Craswell |
| 2024 | WWW | MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels. | Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul N. Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Nikhil Rao, Anlei Dong, Wenqi Jiang, Zheng Liu, Mingqin Li, Chuanjie Liu, Zengzhong Li, Rangan Majumder, Jennifer Neville, Andy Oakley, Knut Magne Risvik, Harsha Vardhan Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang |
| 2024 | SIGIR | What Matters in a Measure? A Perspective from Large-Scale Search Evaluation. | Paul Thomas, Gabriella Kazai, Nick Craswell, Seth Spielman |
| 2024 | SIGIR | Large Language Models can Accurately Predict Searcher Preferences. | Paul Thomas, Seth Spielman, Nick Craswell, Bhaskar Mitra |
| 2024 | SIGIR | Synthetic Test Collections for Retrieval Evaluation. | Hossein A. Rahmani, Nick Craswell, Emine Yilmaz, Bhaskar Mitra, Daniel Campos |
| 2024 | SIGIR | LLM4Eval: Large Language Model for Evaluation in IR. | Hossein A. Rahmani, Clemencia Siro, Mohammad Aliannejadi, Nick Craswell, Charles L. A. Clarke, Guglielmo Faggioli, Bhaskar Mitra, Paul Thomas, Emine Yilmaz |
| 2023 | WWW | Algorithmic Vibe in Information Retrieval. | Ali Montazeralghaem, Nick Craswell, Ryen W. White, Ahmed Hassan Awadallah, Byungki Byun |
| 2023 | WWW | Zero-shot Clarifying Question Generation for Conversational Search. | Zhenduo Wang, Yuancheng Tu, Corby Rosset, Nick Craswell, Ming Wu, Qingyao Ai |
| 2023 | SIGIR | Patterns of Gender-Specializing Query Reformulation. | Amifa Raj, Bhaskar Mitra, Nick Craswell, Michael D. Ekstrand |
| 2022 | CHIIR | The Crowd is Made of People: Observations from Large-Scale Crowd Labelling. | Paul Thomas, Gabriella Kazai, Ryen White, Nick Craswell |
| 2022 | ECIR | Less is Less: When are Snippets Insufficient for Human vs Machine Relevance Estimation? | Gabriella Kazai, Bhaskar Mitra, Anlei Dong, Nick Craswell, Linjun Yang |
| 2022 | SIGIR | Fostering Coopetition While Plugging Leaks: The Design and Implementation of the MS MARCO Leaderboards. | Jimmy Lin, Daniel Campos, Nick Craswell, Bhaskar Mitra, Emine Yilmaz |
| 2022 | SIGIR | Too Many Relevants: Whither Cranfield Test Collections? | Ellen M. Voorhees, Nick Craswell, Jimmy Lin |
| 2022 | SIGIR | Human Preferences as Dueling Bandits. | Xinyi Yan, Chengxi Luo, Charles L. A. Clarke, Nick Craswell, Ellen M. Voorhees, Pablo Castells |
| 2021 | CIKM | Analysing Mixed Initiatives and Search Strategies during Conversational Search. | Mohammad Aliannejadi, Leif Azzopardi, Hamed Zamani, Evangelos Kanoulas, Paul Thomas, Nick Craswell |
| 2021 | SIGIR | MS MARCO: Benchmarking Ranking Models in the Large-Data Regime. | Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Jimmy Lin |
| 2021 | SIGIR | TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime. | Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Ellen M. Voorhees, Ian Soboroff |
| 2021 | SIGIR | Intra-Document Cascading: Learning to Select Passages for Neural Document Ranking. | Sebastian Hofsttter, Bhaskar Mitra, Hamed Zamani, Nick Craswell, Allan Hanbury |
| 2021 | SIGIR | Significant Improvements over the State of the Art? A Case Study of the MS MARCO Document Ranking Leaderboard. | Jimmy Lin, Daniel Campos, Nick Craswell, Bhaskar Mitra, Emine Yilmaz |
| 2021 | SIGIR | Do Affective Cues Validate Behavioural Metrics for Search? | Daniel McDuff, Paul Thomas, Nick Craswell, Kael Rowan, Mary Czerwinski |
| 2021 | SIGIR | Improving Transformer-Kernel Ranking Model Using Conformer and Query Term Independence. | Bhaskar Mitra, Sebastian Hofsttter, Hamed Zamani, Nick Craswell |
| 2020 | CHIIR | Data-Driven Evaluation Metrics for Heterogeneous Search Engine Result Pages. | Leif Azzopardi, Ryen W. White, Paul Thomas, Nick Craswell |
| 2020 | CIKM | ORCAS: 20 Million Clicked Query-Document Pairs for Analyzing Search. | Nick Craswell, Daniel Campos, Bhaskar Mitra, Emine Yilmaz, Bodo Billerbeck |
| 2020 | CIKM | MIMICS: A Large-Scale Data Collection for Search Clarification. | Hamed Zamani, Gord Lueck, Everest Chen, Rodolfo Quispe, Flint Luu, Nick Craswell |
| 2020 | WWW | Leading Conversational Search by Suggesting Useful Questions. | Corbin Rosset, Chenyan Xiong, Xia Song, Daniel Campos, Nick Craswell, Saurabh Tiwary, Paul N. Bennett |
| 2020 | WWW | Generating Clarifying Questions for Information Retrieval. | Hamed Zamani, Susan T. Dumais, Nick Craswell, Paul N. Bennett, Gord Lueck |
| 2020 | SIGIR | Expressions of Style in Information Seeking Conversation with an Agent. | Paul Thomas, Daniel McDuff, Mary Czerwinski, Nick Craswell |
| 2020 | SIGIR | Local Self-Attention over Long Text for Efficient Document Retrieval. | Sebastian Hofsttter, Hamed Zamani, Bhaskar Mitra, Nick Craswell, Allan Hanbury |
| 2020 | SIGIR | On the Reliability of Test Collections for Evaluating Systems of Different Types. | Emine Yilmaz, Nick Craswell, Bhaskar Mitra, Daniel Campos |
| 2020 | SIGIR | Macaw: An Extensible Conversational Information Seeking Platform. | Hamed Zamani, Nick Craswell |
| 2020 | SIGIR | Analyzing and Learning from User Interactions for Search Clarification. | Hamed Zamani, Bhaskar Mitra, Everest Chen, Gord Lueck, Fernando Diaz, Paul N. Bennett, Nick Craswell, Susan T. Dumais |
| 2019 | ICTIR | Relevance Modeling with Multiple Query Variations. | Xiaolu Lu, Oren Kurland, J. Shane Culpepper, Nick Craswell, Ofri Rom |
| 2019 | ICTIR | A Comparative Analysis of Human and Automatic Query Variants. | Binsheng Liu, Nick Craswell, Xiaolu Lu, Oren Kurland, J. Shane Culpepper |
| 2019 | SIGIR | The Emotion Profile of Web Search. | Gabriella Kazai, Paul Thomas, Nick Craswell |
| 2019 | SIGIR | An Axiomatic Approach to Regularizing Neural Ranking Models. | Corby Rosset, Bhaskar Mitra, Chenyan Xiong, Nick Craswell, Xia Song, Saurabh Tiwary |
| 2019 | SIGIR | Generic Intent Representation in Web Search. | Hongfei Zhang, Xia Song, Chenyan Xiong, Corby Rosset, Paul N. Bennett, Nick Craswell, Saurabh Tiwary |
| 2018 | ADCS | Better Effectiveness Metrics for SERPs, Cards, and Rankings. | Paul Thomas, Alistair Moffat, Peter Bailey, Falk Scholer, Nick Craswell |
| 2018 | CHIIR | Style and Alignment in Information-Seeking Conversation. | Paul Thomas, Mary Czerwinski, Daniel McDuff, Nick Craswell, Gloria Mark |
| 2018 | CHIIR | Study of Relevance and Effort across Devices. | Manisha Verma, Emine Yilmaz, Nick Craswell |
| 2018 | SIGIR | Measuring the Utility of Search Engine Result Pages: An Information Foraging Based Measure. | Leif Azzopardi, Paul Thomas, Nick Craswell |
| 2018 | SIGIR | SIGIR 2018 Workshop on Learning from Limited or Noisy Data for Information Retrieval. | Hamed Zamani, Mostafa Dehghani, Fernando Diaz, Hang Li, Nick Craswell |
| 2018 | WSDM | Neural Ranking Models with Multiple Document Fields. | Hamed Zamani, Bhaskar Mitra, Xia Song, Nick Craswell, Saurabh Tiwary |
| 2017 | CHIIR | Large-Scale Analysis of Email Search and Organizational Strategies. | Kanika Narang, Susan T. Dumais, Nick Craswell, Daniel J. Liebling, Qingyao Ai |
| 2017 | CHIIR | A Theoretical Framework for Conversational Search. | Filip Radlinski, Nick Craswell |
| 2017 | ICMI | Multimodal analysis of vocal collaborative search: a public corpus and results. | Daniel McDuff, Paul Thomas, Mary Czerwinski, Nick Craswell |
| 2017 | WWW | Characterizing Email Search using Large-scale Behavioral Logs and Surveys. | Qingyao Ai, Susan T. Dumais, Nick Craswell, Daniel J. Liebling |
| 2017 | WWW | Learning to Match using Local and Distributed Representations of Text for Web Search. | Bhaskar Mitra, Fernando Diaz, Nick Craswell |
| 2017 | SIGIR | Understanding and Modeling Success in Email Search. | Jin Young Kim, Nick Craswell, Susan T. Dumais, Filip Radlinski, Fang Liu |
| 2017 | SIGIR | SIGIR 2017 Workshop on Neural Information Retrieval (Neu-IR'17). | Nick Craswell, W. Bruce Croft, Maarten de Rijke, Jiafeng Guo, Bhaskar Mitra |
| 2017 | SIGIR | Luandri: A Clean Lua Interface to the Indri Search Engine. | Bhaskar Mitra, Fernando Diaz, Nick Craswell |
| 2017 | WSDM | Neural Models for Full Text Search. | Nick Craswell |
| 2017 | WSDM | Neural Text Embeddings for Information Retrieval. | Bhaskar Mitra, Nick Craswell |
| 2016 | ACL | Query Expansion with Locally-Trained Word Embeddings. | Fernando Diaz, Bhaskar Mitra, Nick Craswell |
| 2016 | WWW | Improving Document Ranking with Dual Word Embeddings. | Eric T. Nalisnick, Bhaskar Mitra, Nick Craswell, Rich Caruana |
| 2016 | WWW | Did You Say U2 or YouTube?: Inferring Implicit Transcripts from Voice Search Logs. | Milad Shokouhi, Umut Ozertem, Nick Craswell |
| 2016 | SIGIR | Ingrams: A Neuropsychological Explanation For Why People Search. | Peter Bailey, Nick Craswell |
| 2016 | SIGIR | Neu-IR: The SIGIR 2016 Workshop on Neural Information Retrieval. | Nick Craswell, W. Bruce Croft, Jiafeng Guo, Bhaskar Mitra, Maarten de Rijke |
| 2016 | SIGIR | Explicit In Situ User Feedback for Web Search Results. | Jin Young Kim, Jaime Teevan, Nick Craswell |
| 2016 | WSDM | On Obtaining Effort Based Judgements for Information Retrieval. | Manisha Verma, Emine Yilmaz, Nick Craswell |
| 2015 | CIKM | Query Auto-Completion for Rare Prefixes. | Bhaskar Mitra, Nick Craswell |
| 2015 | SIGIR | Inter-Category Variation in Location Search. | Chia-Jung Lee, Nick Craswell, Vanessa Murdock |
| 2014 | CIKM | Effect of Intent Descriptions on Retrieval Evaluation. | Emine Yilmaz, Evangelos Kanoulas, Nick Craswell |
| 2014 | CIKM | Relevance and Effort: An Analysis of Document Utility. | Emine Yilmaz, Manisha Verma, Nick Craswell, Filip Radlinski, Peter Bailey |
| 2014 | WSDM | Log-based personalization: the 4th web search click data (WSCD) workshop. | Pavel Serdyukov, Georges Dupret, Nick Craswell |
| 2013 | CIKM | Beyond clicks: query reformulation as a predictor of search satisfaction. | Ahmed Hassan Awadallah, Xiaolin Shi, Nick Craswell, Bill Ramsey |
| 2013 | CIKM | User intent and assessor disagreement in web search evaluation. | Gabriella Kazai, Emine Yilmaz, Nick Craswell, Seyed M. M. Tahaghoghi |
| 2013 | WSDM | Robust query rewriting using anchor data. | Nick Craswell, Bodo Billerbeck, Dennis Fetterly, Marc Najork |
| 2013 | WSDM | Optimized interleaving for online retrieval evaluation. | Filip Radlinski, Nick Craswell |
| 2013 | WSDM | WSCD2013: workshop on web search click data 2013. | Pavel Serdyukov, Georges Dupret, Nick Craswell |
| 2012 | CIKM | An analysis of systematic judging errors in information retrieval. | Gabriella Kazai, Nick Craswell, Emine Yilmaz, Seyed M. M. Tahaghoghi |
| 2012 | SIGIR | On judgments obtained from a commercial search engine. | Emine Yilmaz, Gabriella Kazai, Nick Craswell, Seyed M. M. Tahaghoghi |
| 2012 | WSDM | WSCD 2012: workshop on web search click data 2012. | Pavel Serdyukov, Nick Craswell, Georges Dupret |
| 2011 | ECIR | The Power of Peers. | Nick Craswell, Dennis Fetterly, Marc Najork |
| 2011 | ECIR | ReFER: Effective Relevance Feedback for Entity Ranking. | Tereza Iofciu, Gianluca Demartini, Nick Craswell, Arjen P. de Vries |
| 2011 | SIGIR | Regularized latent semantic indexing. | Quan Wang, Jun Xu, Hang Li, Nick Craswell |
| 2011 | WSDM | A comparative analysis of cascade measures for novelty and diversity. | Charles L. A. Clarke, Nick Craswell, Ian Soboroff, Azin Ashkan |
| 2011 | WSDM | LambdaMerge: merging the results of query reformulations. | Daniel Sheldon, Milad Shokouhi, Martin Szummer, Nick Craswell |
| 2010 | CIKM | Expected browsing utility for web search evaluation. | Emine Yilmaz, Milad Shokouhi, Nick Craswell, Stephen Robertson |
| 2010 | WWW | Inferring query intent from reformulations and clicks. | Filip Radlinski, Martin Szummer, Nick Craswell |
| 2010 | SIGIR | Evaluating whole-page relevance. | Peter Bailey, Nick Craswell, Ryen W. White, Liwei Chen, Ashwin Satyanarayana, Seyed M. M. Tahaghoghi |
| 2010 | SIGIR | Comparing the sensitivity of information retrieval metrics. | Filip Radlinski, Nick Craswell |
| 2010 | SIGIR | Metrics for assessing sets of subtopics. | Filip Radlinski, Martin Szummer, Nick Craswell |
| 2009 | ECIR | Measuring the Search Effectiveness of a Breadth-First Crawl. | Dennis Fetterly, Nick Craswell, Vishwa Vinay |
| 2009 | ECIR | Quality-Oriented Search for Depression Portals. | Thanh Tin Tang, David Hawking, Ramesh S. Sankaranarayana, Kathleen Griffiths, Nick Craswell |
| 2009 | ECIR | Query Expansion Using External Evidence. | Zhijun Yin, Milad Shokouhi, Nick Craswell |
| 2009 | SIGIR | The impact of crawl policy on web search effectiveness. | Dennis Fetterly, Nick Craswell, Vishwa Vinay |
| 2009 | SIGIR | Evaluating the Impact of Snippet Highlighting in Search. | Tereza Iofciu, Nick Craswell, Milad Shokouhi |
| 2009 | SIGIR | Incorporating User Behavior Information in IR Evaluation. | Emine Yilmaz, Milad Shokouhi, Nick Craswell, Stephen Robertson |
| 2009 | WSDM | Wikipedia pages as entry points for book search. | Marijn Koolen, Gabriella Kazai, Nick Craswell |
| 2008 | CIKM | Efficient and effective link analysis with precomputed salsa maps. | Marc Najork, Nick Craswell |
| 2008 | WWW | Behavioral classification on the click graph. | Martin Szummer, Nick Craswell |
| 2008 | SIGIR | Relevance assessment: are judges exchangeable and does it matter. | Peter Bailey, Nick Craswell, Ian Soboroff, Paul Thomas, Arjen P. de Vries, Emine Yilmaz |
| 2008 | SIGIR | Search effectiveness with a breadth-first crawl. | Dennis Fetterly, Nick Craswell, Vishwa Vinay |
| 2008 | WSDM | An experimental comparison of click position-bias models. | Nick Craswell, Onno Zoeter, Michael J. Taylor, Bill Ramsey |
| 2007 | ECIR | Searching Documents Based on Relevance and Type. | Jun Xu, Yunbo Cao, Hang Li, Nick Craswell, Yalou Huang |
| 2007 | SIGIR | Random walks on the click graph. | Nick Craswell, Martin Szummer |
| 2006 | CIKM | Optimisation methods for ranking functions with multiple parameters. | Michael J. Taylor, Hugo Zaragoza, Nick Craswell, Stephen Robertson, Chris Burges |
| 2005 | CIKM | Focused crawling for both topical relevance and quality of medical information. | Thanh Tin Tang, David Hawking, Nick Craswell, Kathleen Griffiths |
| 2005 | SIGIR | Relevance weighting for query independent evidence. | Nick Craswell, Stephen E. Robertson, Hugo Zaragoza, Michael J. Taylor |
| 2004 | ADC | Performance and Cost Tradeoffs in Web Search.. | Nick Craswell, Francis Crimmins, David Hawking, Alistair Moffat |
| 2004 | ADC | How Valuable is External Link Evidence When Searching Enterprise Webs? | David Hawking, Francis Crimmins, Nick Craswell, Trystan Upstill |
| 2004 | ADCS | Focused Crawling in Depression Portal Search: A Feasibility Study. | Thanh Tin Tang, David Hawking, Nick Craswell, Ramesh S. Sankaranarayana |
| 2004 | WWW | Testbed for information extraction from deep web. | Yasuhiro Yamada, Nick Craswell, Tetsuya Nakatoh, Sachio Hirokawa |
| 2004 | SIGIR | Toward better weighting of anchors. | David Hawking, Trystan Upstill, Nick Craswell |
| 2003 | ADC | Automated Discovery of Search Interfaces on the Web. | Jared Cope, Nick Craswell, David Hawking |
| 2002 | ADCS | XML Document Retrieval with PADRE. | Nick Craswell, David Hawking, Alexander Krumpholz, Ian D. Mathieson, James A. Thom, Anne-Marie Vercoustre, Peter Wilkins, Mingfang Wu |
| 2002 | ADCS | Buying bestsellers online: A case study in Search & Searchability. | Trystan Upstill, Nick Craswell, David Hawking |
| 2001 | WWW | Which Search Engine is Best at Finding Online Services? | David Hawking, Nick Craswell, Kathleen Griffiths |
| 2001 | SIGIR | Effective Site Finding Using Link Anchor Information. | Nick Craswell, David Hawking, Stephen E. Robertson |
| 1999 | ADC | Merging Results From Isolated Search Engines. | Nick Craswell, David Hawking, Paul B. Thistlewaite |