Timo Breuer

2026

doi dblp
Evaluating Information Retrieval Models Along Time: The LongEval Lab at CLEF 2026.
Timo Breuer|Matteo Cancellieri|Alaa El-Ebshihy|Maik Fröbe|Petra Galuscáková|Lorraine Goeuriot|Gabriel Iturra-Bocaz|Jüri Keller|Petr Knoth|Andreas Konstantin Kruff|Philippe Mulhem|Florina Piroi|David Pride|Philipp Schaer|Didier Schwab
Advances in Information Retrieval - 48th European Conference on Information Retrieval, ECIR 2026, Delft, The Netherlands, March 29 - April 2, 2026, Proceedings, Part IV
doi dblp
Sim4IA-Bench: A User Simulation Benchmark Suite for Next Query and Utterance Prediction.
Andreas Konstantin Kruff|Christin Katharina Kreutz|Timo Breuer|Philipp Schaer|Krisztian Balog
Advances in Information Retrieval - 48th European Conference on Information Retrieval, ECIR 2026, Delft, The Netherlands, March 29 - April 2, 2026, Proceedings, Part IV

2025

doi dblp
User Simulation in Practice: Lessons Learned from Three Shared Tasks.
Marcel Gohsen|Zahra Abbasiantaeb|Mohammad Aliannejadi|Krisztian Balog|Timo Breuer|Jeffrey Dalton|Maik Fröbe|Christin Katharina Kreutz|Andreas Kruff|Simon Lupart|Nailia Mirzakhmedova|Harrisen Scells|Philipp Schaer|Benno Stein|Johannes Kiesel
SIGIR Forum 2025 Volume 59 Issue 2
doi dblp
Report on the Second Workshop on Simulations for Information Access (Sim4IA 2025) at SIGIR 2025.
Philipp Schaer|Christin Katharina Kreutz|Krisztian Balog|Timo Breuer|Andreas Kruff|Mohammad Aliannejadi|Christine Bauer|Nolwenn Bernard|Nicola Ferro|Marcel Gohsen|Nurul Lubis|Saber Zerhoudi
SIGIR Forum 2025 Volume 59 Issue 2
doi dblp
Evaluating Contrastive Feedback for Effective User Simulations.
Andreas Konstantin Kruff|Timo Breuer|Philipp Schaer
Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025
doi dblp
Second SIGIR Workshop on Simulations for Information Access (Sim4IA 2025).
Philipp Schaer|Christin Katharina Kreutz|Krisztian Balog|Timo Breuer|Andreas Konstantin Kruff
Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025

2024

doi dblp
Report on the 1st Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024.
Timo Breuer|Christin Katharina Kreutz|Norbert Fuhr|Krisztian Balog|Philipp Schaer|Nolwenn Bernard|Ingo Frommholz|Marcel Gohsen|Kaixin Ji|Gareth J. F. Jones|Jüri Keller|Jiqun Liu|Martin Mladenov|Gabriella Pasi|Johanne R. Trippas|Xi Wang|Saber Zerhoudi|ChengXiang Zhai
SIGIR Forum 2024 Volume 58 Issue 2
doi dblp
Replicability Measures for Longitudinal Information Retrieval Evaluation.
Jüri Keller|Timo Breuer|Philipp Schaer
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 15th International Conference of the CLEF Association, CLEF 2024, Grenoble, France, September 9-12, 2024, Proceedings, Part I
dblp
The Two Sides of the Coin: Hallucination Generation and Detection with LLMs as Evaluators for LLMs.
Anh Thu Maria Bui|Saskia Felizitas Brech|Natalie Hußfeldt|Tobias Jennert|Melanie Ullrich|Timo Breuer|Narjes Nikzad-Khasmakhi|Philipp Schaer
Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), Grenoble, France, 9-12 September, 2024.
dblp
Leveraging Prior Relevance Signals in Web Search.
Jüri Keller|Timo Breuer|Philipp Schaer
Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), Grenoble, France, 9-12 September, 2024.
doi dblp
Context-Driven Interactive Query Simulations Based on Generative Large Language Models.
Björn Engelmann|Timo Breuer|Jana Isabelle Friese|Philipp Schaer|Norbert Fuhr
Advances in Information Retrieval - 46th European Conference on Information Retrieval, ECIR 2024, Glasgow, UK, March 24-28, 2024, Proceedings, Part II
doi dblp
Evaluation of Temporal Change in IR Test Collections.
Jüri Keller|Timo Breuer|Philipp Schaer
Proceedings of the 2024 ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2024, Washington, DC, USA, 13 July 2024
doi dblp
Browsing and Searching Metadata of TREC.
Timo Breuer|Ellen M. Voorhees|Ian Soboroff
Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2024, Washington DC, USA, July 14-18, 2024
doi dblp
SIGIR 2024 Workshop on Simulations for Information Access (Sim4IA 2024).
Philipp Schaer|Christin Katharina Kreutz|Krisztian Balog|Timo Breuer|Norbert Fuhr
Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2024, Washington DC, USA, July 14-18, 2024

2023

doi dblp
Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education.
Christine Bauer|Ben Carterette|Nicola Ferro|Norbert Fuhr|Joeran Beel|Timo Breuer|Charles L. A. Clarke|Anita Crescenzi|Gianluca Demartini|Giorgio Maria Di Nunzio|Laura Dietz|Guglielmo Faggioli|Bruce Ferwerda|Maik Fröbe|Matthias Hagen|Allan Hanbury|Claudia Hauff|Dietmar Jannach|Noriko Kando|Evangelos Kanoulas|Bart P. Knijnenburg|Udo Kruschwitz|Meijie Li|Maria Maistro|Lien Michiels|Andrea Papenmeier|Martin Potthast|Paolo Rosso|Alan Said|Philipp Schaer|Christin Seifert|Damiano Spina|Benno Stein|Nava Tintarev|Julián Urbano|Henning Wachsmuth|Martijn C. Willemsen|Justin Zobel
SIGIR Forum 2023 Volume 57 Issue 1
doi dblp
An in-depth investigation on the behavior of measures to quantify reproducibility.
Maria Maistro|Timo Breuer|Philipp Schaer|Nicola Ferro
Information Processing and Management 2023 Volume 60 Issue 3
doi dblp
Simulating Users in Interactive Web Table Retrieval.
Björn Engelmann|Timo Breuer|Philipp Schaer
Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, CIKM 2023, Birmingham, United Kingdom, October 21-25, 2023
dblp
Evaluating Temporal Persistence Using Replicability Measures.
Jüri Keller|Timo Breuer|Philipp Schaer
Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), Thessaloniki, Greece, September 18th to 21st, 2023.

2022

doi dblp
Validating Simulations of User Query Variants.
Timo Breuer|Norbert Fuhr|Philipp Schaer
Advances in Information Retrieval - 44th European Conference on IR Research, ECIR 2022, Stavanger, Norway, April 10-14, 2022, Proceedings, Part I
doi dblp
ir_metadata: An Extensible Metadata Schema for IR Experiments.
Timo Breuer|Jüri Keller|Philipp Schaer
SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022

2021

doi dblp
Evaluating Elements of Web-Based Data Enrichment for Pseudo-relevance Feedback Retrieval.
Timo Breuer|Melanie Pest|Philipp Schaer
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 12th International Conference of the CLEF Association, CLEF 2021, Virtual Event, September 21-24, 2021, Proceedings
doi dblp
Overview of LiLAS 2021 - Living Labs for Academic Search.
Philipp Schaer|Timo Breuer|Leyla Jael Castro|Benjamin Wolff|Johann Schaible|Narges Tavakolpoursaleh
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 12th International Conference of the CLEF Association, CLEF 2021, Virtual Event, September 21-24, 2021, Proceedings
dblp
Overview of LiLAS 2021 - Living Labs for Academic Search (Extended Overview).
Philipp Schaer|Timo Breuer|Leyla Jael Castro|Benjamin Wolff|Johann Schaible|Narges Tavakolpoursaleh
Proceedings of the Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum, Bucharest, Romania, September 21st - to - 24th, 2021.
doi dblp
repro_eval: A Python Interface to Reproducibility Measures of System-Oriented IR Experiments.
Timo Breuer|Nicola Ferro|Maria Maistro|Philipp Schaer
Advances in Information Retrieval - 43rd European Conference on IR Research, ECIR 2021, Virtual Event, March 28 - April 1, 2021, Proceedings, Part II

2020

doi dblp
Reproducible Online Search Experiments.
Timo Breuer
Advances in Information Retrieval - 42nd European Conference on IR Research, ECIR 2020, Lisbon, Portugal, April 14-17, 2020, Proceedings, Part II
doi dblp
How to Measure the Reproducibility of System-oriented IR Experiments.
Timo Breuer|Craig Macdonald|Craig Macdonald|Nicola Ferro|Timo Breuer|Norbert Fuhr|Maria Maistro|Tetsuya Sakai|Philipp Schaer|Ian Soboroff
Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25-30, 2020

2019

dblp
Replicability and Reproducibility of Automatic Routing Runs.
Timo Breuer|Philipp Schaer
Working Notes of CLEF 2019 - Conference and Labs of the Evaluation Forum, Lugano, Switzerland, September 9-12, 2019.