Daniel Campos

2025

Ragnarök: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track.

Ronak Pradeep|Nandan Thakur|Sahel Sharifymoghaddam|Eric Zhang|Ryan Nguyen|Daniel Campos|Nick Craswell|Jimmy Lin

Advances in Information Retrieval - 47th European Conference on Information Retrieval, ECIR 2025, Lucca, Italy, April 6-10, 2025, Proceedings, Part I

ColBERT-Serve: Efficient Multi-stage Memory-Mapped Scoring.

Kaili Huang|Thejas Venkatesh|Uma Dingankar|Antonio Mallia|Daniel Campos|Jian Jiao|Christopher Potts|Matei Zaharia|Kwabena Boahen|Omar Khattab|Saarthak Sarup|Keshav Santhanam

Advances in Information Retrieval - 47th European Conference on Information Retrieval, ECIR 2025, Lucca, Italy, April 6-10, 2025, Proceedings, Part IV

A Large-Scale Study of Relevance Assessments with Large Language Models Using UMBRELA.

Shivani Upadhyay|Ronak Pradeep|Nandan Thakur|Daniel Campos|Nick Craswell|Ian Soboroff|Jimmy Lin

Proceedings of the 2025 International ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval, ICTIR 2025, Padua, Italy, 18 July 2025

The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models.

Ronak Pradeep|Nandan Thakur|Shivani Upadhyay|Daniel Campos|Nick Craswell|Ian Soboroff|Hoa Trang Dang|Jimmy Lin

Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025

Assessing Support for the TREC 2024 RAG Track: A Large-Scale Comparative Study of LLM and Human Evaluations.

Nandan Thakur|Ronak Pradeep|Shivani Upadhyay|Daniel Campos|Nick Craswell|Ian Soboroff|Hoa Trang Dang|Jimmy Lin

Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025

2024

Synthetic Test Collections for Retrieval Evaluation.

Hossein A. Rahmani|Nick Craswell|Emine Yilmaz|Bhaskar Mitra|Daniel Campos

Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2024, Washington DC, USA, July 14-18, 2024

2023

OVERVIEW OF THE TREC 2023 PRODUCT PRODUCT SEARCH TRACK.

Daniel Campos|Surya Kallumadi|Corby Rosset|Cheng Xiang Zhai|Alessandro Magnani

The Thirty-Second Text REtrieval Conference Proceedings (TREC 2023), Gaithersburg, MD, USA, November 14-17, 2023

Overview of the TREC 2023 Deep Learning Track.

Nick Craswell|Bhaskar Mitra|Emine Yilmaz|Hossein A. Rahmani|Daniel Campos|Jimmy Lin|Ellen M. Voorhees|Ian Soboroff

The Thirty-Second Text REtrieval Conference Proceedings (TREC 2023), Gaithersburg, MD, USA, November 14-17, 2023

2022

Fostering Coopetition While Plugging Leaks: The Design and Implementation of the MS MARCO Leaderboards.

Jimmy Lin|Daniel Campos|Nick Craswell|Bhaskar Mitra|Emine Yilmaz

SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022

Overview of the TREC 2022 Deep Learning Track.

Nick Craswell|Bhaskar Mitra|Emine Yilmaz|Daniel Campos|Jimmy Lin|Ellen M. Voorhees|Ian Soboroff

Proceedings of the Thirty-First Text REtrieval Conference, TREC 2022, online, November 15-19, 2022

2021

MS MARCO: Benchmarking Ranking Models in the Large-Data Regime.

Nick Craswell|Fabrizio Silvestri|Bhaskar Mitra|Nick Craswell|Fabrizio Silvestri|Emine Yilmaz|Ranieri Baraglia|Daniel Campos|Franco Maria Nardini|Jimmy Lin

SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021

TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime.

Nick Craswell|Bhaskar Mitra|Emine Yilmaz|Daniel Campos|Ellen M. Voorhees|Ian Soboroff

SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021

Significant Improvements over the State of the Art? A Case Study of the MS MARCO Document Ranking Leaderboard.

Jimmy Lin|Daniel Campos|Nick Craswell|Bhaskar Mitra|Emine Yilmaz

SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021

Overview of the TREC 2021 Deep Learning Track.

Nick Craswell|Bhaskar Mitra|Emine Yilmaz|Daniel Campos|Jimmy Lin

Proceedings of the Thirtieth Text REtrieval Conference, TREC 2021, online, November 15-19, 2021

2020

ORCAS: 20 Million Clicked Query-Document Pairs for Analyzing Search.

Nick Craswell|Daniel Campos|Bhaskar Mitra|Emine Yilmaz|Bodo Billerbeck

CIKM '20: The 29th ACM International Conference on Information and Knowledge Management, Virtual Event, Ireland, October 19-23, 2020

On the Reliability of Test Collections for Evaluating Systems of Different Types.

Emine Yilmaz|Nick Craswell|Bhaskar Mitra|Daniel Campos

Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25-30, 2020

Overview of the TREC 2020 Deep Learning Track.

Nick Craswell|Bhaskar Mitra|Emine Yilmaz|Daniel Campos

Proceedings of the Twenty-Ninth Text REtrieval Conference, TREC 2020, Virtual Event [Gaithersburg, Maryland, USA], November 16-20, 2020.

Leading Conversational Search by Suggesting Useful Questions.

Corbin Rosset|Chenyan Xiong|Xia Song|Daniel Campos|Nick Craswell|Saurabh Tiwary|Paul N. Bennett

WWW '20: The Web Conference 2020, Taipei, Taiwan, April 20-24, 2020