Philipp Schaer

2026

doi dblp

Validating Search Query Simulations: A Taxonomy of Measures.

Andreas Konstantin Kruff|Nolwenn Bernard|Philipp Schaer

Advances in Information Retrieval - 48th European Conference on Information Retrieval, ECIR 2026, Delft, The Netherlands, March 29 - April 2, 2026, Proceedings, Part I

doi dblp

Evaluating Information Retrieval Models Along Time: The LongEval Lab at CLEF 2026.

Timo Breuer|Matteo Cancellieri|Alaa El-Ebshihy|Maik Fröbe|Petra Galuscáková|Lorraine Goeuriot|Gabriel Iturra-Bocaz|Jüri Keller|Petr Knoth|Andreas Konstantin Kruff|Philippe Mulhem|Florina Piroi|David Pride|Philipp Schaer|Didier Schwab

Advances in Information Retrieval - 48th European Conference on Information Retrieval, ECIR 2026, Delft, The Netherlands, March 29 - April 2, 2026, Proceedings, Part IV

doi dblp

LISP - A Rich Interaction Dataset and Loggable Interactive Search Platform.

Jana Isabelle Friese|Andreas Konstantin Kruff|Philipp Schaer|Norbert Fuhr|Nicola Ferro

Advances in Information Retrieval - 48th European Conference on Information Retrieval, ECIR 2026, Delft, The Netherlands, March 29 - April 2, 2026, Proceedings, Part IV

doi dblp

Sim4IA-Bench: A User Simulation Benchmark Suite for Next Query and Utterance Prediction.

Andreas Konstantin Kruff|Christin Katharina Kreutz|Timo Breuer|Philipp Schaer|Krisztian Balog

Advances in Information Retrieval - 48th European Conference on Information Retrieval, ECIR 2026, Delft, The Netherlands, March 29 - April 2, 2026, Proceedings, Part IV

2025

doi dblp

User Simulation in Practice: Lessons Learned from Three Shared Tasks.

Marcel Gohsen|Zahra Abbasiantaeb|Mohammad Aliannejadi|Krisztian Balog|Timo Breuer|Jeffrey Dalton|Maik Fröbe|Christin Katharina Kreutz|Andreas Kruff|Simon Lupart|Nailia Mirzakhmedova|Harrisen Scells|Philipp Schaer|Benno Stein|Johannes Kiesel

SIGIR Forum 2025 Volume 59 Issue 2

doi dblp

Report on the Second Workshop on Simulations for Information Access (Sim4IA 2025) at SIGIR 2025.

Philipp Schaer|Christin Katharina Kreutz|Krisztian Balog|Timo Breuer|Andreas Kruff|Mohammad Aliannejadi|Christine Bauer|Nolwenn Bernard|Nicola Ferro|Marcel Gohsen|Nurul Lubis|Saber Zerhoudi

SIGIR Forum 2025 Volume 59 Issue 2

doi dblp

LongEval at CLEF 2025: Longitudinal Evaluation of IR Systems on Web and Scientific Data.

Matteo Cancellieri|Alaa El-Ebshihy|Tobias Fink|Maik Fröbe|Petra Galuscáková|Gabriela González Sáez|Lorraine Goeuriot|David Iommi|Jüri Keller|Petr Knoth|Philippe Mulhem|Florina Piroi|David Pride|Philipp Schaer

Experimental IR Meets Multilinguality, Multimodality, and Interaction - 16th International Conference of the CLEF Association, CLEF 2025, Madrid, Spain, September 9-12, 2025, Proceedings

doi dblp

Simplified Longitudinal Retrieval Experiments: A Case Study on Query Expansion and Document Boosting.

Jüri Keller|Maik Fröbe|Gijs Hendriksen|Daria Alexander|Martin Potthast|Philipp Schaer

Experimental IR Meets Multilinguality, Multimodality, and Interaction - 16th International Conference of the CLEF Association, CLEF 2025, Madrid, Spain, September 9-12, 2025, Proceedings

dblp

Extended Abstract of LongEval at CLEF 2025: Longitudinal Evaluation of IR Systems on Web and Scientific Data.

Matteo Cancellieri|Alaa El-Ebshihy|Tobias Fink|Maik Fröbe|Petra Galuscáková|Gabriela González Sáez|Lorraine Goeuriot|David Iommi|Jüri Keller|Petr Knoth|Philippe Mulhem|Florina Piroi|David Pride|Philipp Schaer

Working Notes of the Conference and Labs of the Evaluation Forum, CLEF 2025, Madrid, Spain, 9-12 September 2025.

dblp

CIR_cluster at LongEval 2025: Clustering Query Variants for Temporal Generalization.

Arthur Muanza Ndiema|Jüri Keller|Philipp Schaer

Working Notes of the Conference and Labs of the Evaluation Forum, CLEF 2025, Madrid, Spain, 9-12 September 2025.

doi dblp

Counterfactual Query Rewriting to Use Historical Relevance Feedback.

Jüri Keller|Maik Fröbe|Gijs Hendriksen|Daria Alexander|Martin Potthast|Matthias Hagen|Philipp Schaer

Advances in Information Retrieval - 47th European Conference on Information Retrieval, ECIR 2025, Lucca, Italy, April 6-10, 2025, Proceedings, Part III

doi dblp

LongEval at CLEF 2025: Longitudinal Evaluation of IR Model Performance.

Matteo Cancellieri|Alaa El-Ebshihy|Tobias Fink|Petra Galuscáková|Gabriela González Sáez|Lorraine Goeuriot|David Iommi|Jüri Keller|Petr Knoth|Philippe Mulhem|Florina Piroi|David Pride|Philipp Schaer

Advances in Information Retrieval - 47th European Conference on Information Retrieval, ECIR 2025, Lucca, Italy, April 6-10, 2025, Proceedings, Part V

doi dblp

REANIMATOR: Reanimate Retrieval Test Collections with Extracted and Synthetic Resources.

Björn Engelmann|Fabian Haak|Philipp Schaer|Mani Erfanian Abdoust|Linus Netze|Meik Bittkowski

Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025

doi dblp

Evaluating Contrastive Feedback for Effective User Simulations.

Andreas Konstantin Kruff|Timo Breuer|Philipp Schaer

Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025

doi dblp

Second SIGIR Workshop on Simulations for Information Access (Sim4IA 2025).

Philipp Schaer|Christin Katharina Kreutz|Krisztian Balog|Timo Breuer|Andreas Konstantin Kruff

Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025

2024

doi dblp

Replicability Measures for Longitudinal Information Retrieval Evaluation.

Jüri Keller|Timo Breuer|Philipp Schaer

Experimental IR Meets Multilinguality, Multimodality, and Interaction - 15th International Conference of the CLEF Association, CLEF 2024, Grenoble, France, September 9-12, 2024, Proceedings, Part I

dblp

The Two Sides of the Coin: Hallucination Generation and Detection with LLMs as Evaluators for LLMs.

Anh Thu Maria Bui|Saskia Felizitas Brech|Natalie Hußfeldt|Tobias Jennert|Melanie Ullrich|Timo Breuer|Narjes Nikzad-Khasmakhi|Philipp Schaer

Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), Grenoble, France, 9-12 September, 2024.

dblp

Leveraging Prior Relevance Signals in Web Search.

Jüri Keller|Timo Breuer|Philipp Schaer

Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), Grenoble, France, 9-12 September, 2024.

doi dblp

Context-Driven Interactive Query Simulations Based on Generative Large Language Models.

Björn Engelmann|Timo Breuer|Jana Isabelle Friese|Philipp Schaer|Norbert Fuhr

Advances in Information Retrieval - 46th European Conference on Information Retrieval, ECIR 2024, Glasgow, UK, March 24-28, 2024, Proceedings, Part II

doi dblp

Evaluation of Temporal Change in IR Test Collections.

Jüri Keller|Timo Breuer|Philipp Schaer

Proceedings of the 2024 ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2024, Washington, DC, USA, 13 July 2024

doi dblp

SIGIR 2024 Workshop on Simulations for Information Access (Sim4IA 2024).

Philipp Schaer|Christin Katharina Kreutz|Krisztian Balog|Timo Breuer|Norbert Fuhr

Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2024, Washington DC, USA, July 14-18, 2024

dblp

CIR at TREC 2024 RAG: Task 2 - Augmented Generation with Diversified Segments and Knowledge Adaption.

Jüri Keller|Björn Engelmann|Fabian Haak|Philipp Schaer|Hermann Kroll|Christin Katharina Kreutz

Proceedings of the Thirty-Third Text REtrieval Conference, TREC 2024, Gaithersburg, MD, USA, November 18-22, 2024

2023

doi dblp

An in-depth investigation on the behavior of measures to quantify reproducibility.

Maria Maistro|Timo Breuer|Philipp Schaer|Nicola Ferro

Information Processing and Management 2023 Volume 60 Issue 3

doi dblp

Simulating Users in Interactive Web Table Retrieval.

Björn Engelmann|Timo Breuer|Philipp Schaer

Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, CIKM 2023, Birmingham, United Kingdom, October 21-25, 2023

dblp

Text Simplification of Scientific Texts for Non-Expert Readers.

Björn Engelmann|Fabian Haak|Christin Katharina Kreutz|Narjes Nikzad-Khasmakhi|Philipp Schaer

Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), Thessaloniki, Greece, September 18th to 21st, 2023.

dblp

Evaluating Temporal Persistence Using Replicability Measures.

Jüri Keller|Timo Breuer|Philipp Schaer

Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023), Thessaloniki, Greece, September 18th to 21st, 2023.

2022

doi dblp

Validating Simulations of User Query Variants.

Timo Breuer|Norbert Fuhr|Philipp Schaer

Advances in Information Retrieval - 44th European Conference on IR Research, ECIR 2022, Stavanger, Norway, April 10-14, 2022, Proceedings, Part I

doi dblp

ir_metadata: An Extensible Metadata Schema for IR Experiments.

Timo Breuer|Jüri Keller|Philipp Schaer

SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022

2021

doi dblp

Evaluating Elements of Web-Based Data Enrichment for Pseudo-relevance Feedback Retrieval.

Timo Breuer|Melanie Pest|Philipp Schaer

Experimental IR Meets Multilinguality, Multimodality, and Interaction - 12th International Conference of the CLEF Association, CLEF 2021, Virtual Event, September 21-24, 2021, Proceedings

doi dblp

Overview of LiLAS 2021 - Living Labs for Academic Search.

Philipp Schaer|Timo Breuer|Leyla Jael Castro|Benjamin Wolff|Johann Schaible|Narges Tavakolpoursaleh

Experimental IR Meets Multilinguality, Multimodality, and Interaction - 12th International Conference of the CLEF Association, CLEF 2021, Virtual Event, September 21-24, 2021, Proceedings

dblp

Overview of LiLAS 2021 - Living Labs for Academic Search (Extended Overview).

Philipp Schaer|Timo Breuer|Leyla Jael Castro|Benjamin Wolff|Johann Schaible|Narges Tavakolpoursaleh

Proceedings of the Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum, Bucharest, Romania, September 21st - to - 24th, 2021.

doi dblp

repro_eval: A Python Interface to Reproducibility Measures of System-Oriented IR Experiments.

Timo Breuer|Nicola Ferro|Maria Maistro|Philipp Schaer

Advances in Information Retrieval - 43rd European Conference on IR Research, ECIR 2021, Virtual Event, March 28 - April 1, 2021, Proceedings, Part II

doi dblp

Living Lab Evaluation for Life and Social Sciences Search Platforms - LiLAS at CLEF 2021.

Philipp Schaer|Johann Schaible|Leyla Jael Castro

Advances in Information Retrieval - 43rd European Conference on IR Research, ECIR 2021, Virtual Event, March 28 - April 1, 2021, Proceedings, Part II

dblp

IRCologne at TREC 2021 News Track Relation-based re-ranking for background linking.

Björn Engelmann|Philipp Schaer

Proceedings of the Thirtieth Text REtrieval Conference, TREC 2021, online, November 15-19, 2021

2020

doi dblp

Overview of LiLAS 2020 - Living Labs for Academic Search.

Philipp Schaer|Johann Schaible|Leyla Jael García Castro

Experimental IR Meets Multilinguality, Multimodality, and Interaction - 11th International Conference of the CLEF Association, CLEF 2020, Thessaloniki, Greece, September 22-25, 2020, Proceedings

dblp

Overview of LiLAS 2020 - Living Labs for Academic Search Workshop Lab (extended abstract).

Philipp Schaer|Johann Schaible|Leyla Jael García Castro

Working Notes of CLEF 2020 - Conference and Labs of the Evaluation Forum, Thessaloniki, Greece, September 22-25, 2020.

doi dblp

Living Labs for Academic Search at CLEF 2020.

Philipp Schaer|Johann Schaible|Bernd Müller

Advances in Information Retrieval - 42nd European Conference on IR Research, ECIR 2020, Lisbon, Portugal, April 14-17, 2020, Proceedings, Part II

doi dblp

How to Measure the Reproducibility of System-oriented IR Experiments.

Timo Breuer|Craig Macdonald|Craig Macdonald|Timo Breuer|Nicola Ferro|Norbert Fuhr|Maria Maistro|Tetsuya Sakai|Philipp Schaer|Ian Soboroff

Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25-30, 2020

2019

dblp

Replicability and Reproducibility of Automatic Routing Runs.

Timo Breuer|Philipp Schaer

Working Notes of CLEF 2019 - Conference and Labs of the Evaluation Forum, Lugano, Switzerland, September 9-12, 2019.

2017

doi dblp

Enriching Existing Test Collections with OXPath.

Philipp Schaer|Mandy Neumann

Experimental IR Meets Multilinguality, Multimodality, and Interaction - 8th International Conference of the CLEF Association, CLEF 2017, Dublin, Ireland, September 11-14, 2017, Proceedings

dblp

Overview of TREC OpenSearch 2017.

Rolf Jagerman|Krisztian Balog|Philipp Schaer|Johann Schaible|Narges Tavakolpoursaleh|Maarten de Rijke

Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017

dblp

IR-Cologne at TREC 2017 OpenSearch Track: Rerunning Popularity Ranking Experiments in a Living Lab.

Narges Tavakolpoursaleh|Mandy Neumann|Philipp Schaer

Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017

2016

doi dblp

How Relevant is the Long Tail? - A Relevance Assessment Study on Million Short.

Philipp Schaer|Philipp Mayr|Sebastian Sünkler|Dirk Lewandowski

Experimental IR Meets Multilinguality, Multimodality, and Interaction - 7th International Conference of the CLEF Association, CLEF 2016, Évora, Portugal, September 5-8, 2016, Proceedings

dblp

Ideas for a Standard LL4IR Extension - Living Labs from a System Operator's Perspective.

Philipp Schaer|Narges Tavakolpoursaleh

Working Notes of CLEF 2016 - Conference and Labs of the Evaluation forum, Évora, Portugal, 5-8 September, 2016.

dblp

Popularity Ranking for Scientific Literature Using the Characteristic Scores and Scale Method.

Philipp Schaer|Narges Tavakolpoursaleh

Proceedings of The Twenty-Fifth Text REtrieval Conference, TREC 2016, Gaithersburg, Maryland, USA, November 15-18, 2016

2015

dblp

Historical Clicks for Product Search: GESIS at CLEF LL4IR 2015.

Philipp Schaer|Narges Tavakolpoursaleh

Working Notes of CLEF 2015 - Conference and Labs of the Evaluation forum, Toulouse, France, September 8-11, 2015.

2014

doi dblp

Bibliometric-Enhanced Information Retrieval.

Philipp Mayr|Andrea Scharnhorst|Birger Larsen|Philipp Schaer|Peter Mutschke

Advances in Information Retrieval - 36th European Conference on IR Research, ECIR 2014, Amsterdam, The Netherlands, April 13-16, 2014. Proceedings

2013

doi dblp

A framework for specific term recommendation systems.

Thomas Lüke|Philipp Schaer|Philipp Mayr

The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

2012

doi dblp

Better than Their Reputation? On the Reliability of Relevance Assessments with Students.

Philipp Schaer

Information Access Evaluation. Multilinguality, Multimodality, and Visual Analytics - Third International Conference of the CLEF Initiative, CLEF 2012, Rome, Italy, September 17-20, 2012. Proceedings

dblp

Dealing with Sparse Document and Topic Representations: Lab Report for CHiC 2012.

Philipp Schaer|Daniel Hienert|Frank Sawitzki|Andias Wira-Alam|Thomas Lüke

CLEF 2012 Evaluation Labs and Workshop, Online Working Notes, Rome, Italy, September 17-20, 2012

doi dblp

Integrating Interactive Visualizations in the Search Process of Digital Libraries and IR Systems.

Daniel Hienert|Frank Sawitzki|Philipp Schaer|Philipp Mayr

Advances in Information Retrieval - 34th European Conference on IR Research, ECIR 2012, Barcelona, Spain, April 1-5, 2012. Proceedings