2022

doi dblp
ir_metadata: An Extensible Metadata Schema for IR Experiments
Timo Breuer | Jüri Keller | Philipp Schaer
SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022

doi dblp
Validating Simulations of User Query Variants
Timo Breuer | Norbert Fuhr | Philipp Schaer
Advances in Information Retrieval - 44th European Conference on IR Research, ECIR 2022, Stavanger, Norway, April 10-14, 2022, Proceedings, Part I

2021

doi dblp
Overview of LiLAS 2021 - Living Labs for Academic Search
Philipp Schaer | Timo Breuer | Leyla Jael Castro | Benjamin Wolff | Johann Schaible | Narges Tavakolpoursaleh
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 12th International Conference of the CLEF Association, CLEF 2021, Virtual Event, September 21-24, 2021, Proceedings

doi dblp
Evaluating Elements of Web-Based Data Enrichment for Pseudo-relevance Feedback Retrieval
Timo Breuer | Melanie Pest | Philipp Schaer
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 12th International Conference of the CLEF Association, CLEF 2021, Virtual Event, September 21-24, 2021, Proceedings

pdf dblp
Overview of LiLAS 2021 - Living Labs for Academic Search (Extended Overview)
Philipp Schaer | Timo Breuer | Leyla Jael Castro | Benjamin Wolff | Johann Schaible | Narges Tavakolpoursaleh
Proceedings of the Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum, Bucharest, Romania, September 21st - to - 24th, 2021

doi dblp
Living Lab Evaluation for Life and Social Sciences Search Platforms - LiLAS at CLEF 2021
Philipp Schaer | Johann Schaible | Leyla Jael Castro
Advances in Information Retrieval - 43rd European Conference on IR Research, ECIR 2021, Virtual Event, March 28 - April 1, 2021, Proceedings, Part II

doi dblp
repro_eval: A Python Interface to Reproducibility Measures of System-Oriented IR Experiments
Timo Breuer | Nicola Ferro | Maria Maistro | Philipp Schaer
Advances in Information Retrieval - 43rd European Conference on IR Research, ECIR 2021, Virtual Event, March 28 - April 1, 2021, Proceedings, Part II

2020

pdf dblp
Relations Between Relevance Assessments, Bibliometrics and Altmetrics
Timo Breuer | Philipp Schaer | Dirk Tunger
Proceedings of the 10th International Workshop on Bibliometric-enhanced Information Retrieval co-located with 42nd European Conference on Information Retrieval, BIR@ECIR 2020, Lisbon, Portugal, April 14th, 2020 [online only]

pdf dblp
Conference Indexing in Digital Libraries: A Ranking Model and Case Study on dblp
Christopher Michels | Mandy Neumann | Philipp Schaer | Ralf Schenkel
Proceedings of the 10th International Workshop on Bibliometric-enhanced Information Retrieval co-located with 42nd European Conference on Information Retrieval, BIR@ECIR 2020, Lisbon, Portugal, April 14th, 2020 [online only]

doi dblp
How to Measure the Reproducibility of System-oriented IR Experiments
Timo Breuer | Nicola Ferro | Norbert Fuhr | Maria Maistro | Tetsuya Sakai | Philipp Schaer | Ian Soboroff
Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25-30, 2020

doi dblp
Overview of LiLAS 2020 - Living Labs for Academic Search
Philipp Schaer | Johann Schaible | Leyla Jael García Castro
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 11th International Conference of the CLEF Association, CLEF 2020, Thessaloniki, Greece, September 22-25, 2020, Proceedings

pdf dblp
Overview of LiLAS 2020 - Living Labs for Academic Search Workshop Lab (extended abstract)
Philipp Schaer | Johann Schaible | Leyla Jael García Castro
Working Notes of CLEF 2020 - Conference and Labs of the Evaluation Forum, Thessaloniki, Greece, September 22-25, 2020

doi dblp
Living Labs for Academic Search at CLEF 2020
Philipp Schaer | Johann Schaible | Bernd Müller
Advances in Information Retrieval - 42nd European Conference on IR Research, ECIR 2020, Lisbon, Portugal, April 14-17, 2020, Proceedings, Part II

2019

pdf dblp
Dockerizing Automatic Routing Runs for The Open-Source IR Replicability Challenge (OSIRRC 2019)
Timo Breuer | Philipp Schaer
Proceedings of the Open-Source IR Replicability Challenge co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, OSIRRC@SIGIR 2019, Paris, France, July 25, 2019

pdf dblp
STELLA: Towards a Framework for the Reproducibility of Online Search Experiments
Timo Breuer | Philipp Schaer | Narges Tavakolpoursaleh | Johann Schaible | Benjamin Wolff | Bernd Müller
Proceedings of the Open-Source IR Replicability Challenge co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, OSIRRC@SIGIR 2019, Paris, France, July 25, 2019

pdf dblp
Replicability and Reproducibility of Automatic Routing Runs
Timo Breuer | Philipp Schaer
Working Notes of CLEF 2019 - Conference and Labs of the Evaluation Forum, Lugano, Switzerland, September 9-12, 2019

2017

pdf dblp
Overview of TREC OpenSearch 2017
Rolf Jagerman | Krisztian Balog | Philipp Schaer | Johann Schaible | Narges Tavakolpoursaleh | Maarten de Rijke
Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017

pdf dblp
IR-Cologne at TREC 2017 OpenSearch Track: Rerunning Popularity Ranking Experiments in a Living Lab
Narges Tavakolpoursaleh | Mandy Neumann | Philipp Schaer
Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017

doi dblp
Enriching Existing Test Collections with OXPath
Philipp Schaer | Mandy Neumann
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 8th International Conference of the CLEF Association, CLEF 2017, Dublin, Ireland, September 11-14, 2017, Proceedings

2016

pdf dblp
Popularity Ranking for Scientific Literature Using the Characteristic Scores and Scale Method
Philipp Schaer | Narges Tavakolpoursaleh
Proceedings of The Twenty-Fifth Text REtrieval Conference, TREC 2016, Gaithersburg, Maryland, USA, November 15-18, 2016

pdf dblp
Ideas for a Standard LL4IR Extension - Living Labs from a System Operator's Perspective
Philipp Schaer | Narges Tavakolpoursaleh
Working Notes of CLEF 2016 - Conference and Labs of the Evaluation forum, Évora, Portugal, 5-8 September, 2016

doi dblp
How Relevant is the Long Tail? - A Relevance Assessment Study on Million Short
Philipp Schaer | Philipp Mayr | Sebastian Sünkler | Dirk Lewandowski
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 7th International Conference of the CLEF Association, CLEF 2016, Évora, Portugal, September 5-8, 2016, Proceedings

2015

pdf dblp
Historical Clicks for Product Search: GESIS at CLEF LL4IR 2015
Philipp Schaer | Narges Tavakolpoursaleh
Working Notes of CLEF 2015 - Conference and Labs of the Evaluation forum, Toulouse, France, September 8-11, 2015

2014

pdf dblp
On the Connection Between Citation-based and Topical Relevance Ranking: Results of a Pretest using iSearch
Zeljko Carevic | Philipp Schaer
Proceedings of the First Workshop on Bibliometric-enhanced Information Retrieval co-located with 36th European Conference on Information Retrieval (ECIR 2014), Amsterdam, The Netherlands, April 13, 2014

dblp
Proceedings of the First Workshop on Bibliometric-enhanced Information Retrieval co-located with 36th European Conference on Information Retrieval (ECIR 2014), Amsterdam, The Netherlands, April 13, 2014

Proceedings of the First Workshop on Bibliometric-enhanced Information Retrieval co-located with 36th European Conference on Information Retrieval (ECIR 2014), Amsterdam, The Netherlands, April 13, 2014

doi dblp
Bibliometric-Enhanced Information Retrieval
Philipp Mayr | Andrea Scharnhorst | Birger Larsen | Philipp Schaer | Peter Mutschke
Advances in Information Retrieval - 36th European Conference on IR Research, ECIR 2014, Amsterdam, The Netherlands, April 13-16, 2014. Proceedings

2013

doi dblp
A framework for specific term recommendation systems
Thomas Lüke | Philipp Schaer | Philipp Mayr
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

2012

pdf dblp
Dealing with Sparse Document and Topic Representations: Lab Report for CHiC 2012
Philipp Schaer | Daniel Hienert | Frank Sawitzki | Andias Wira-Alam | Thomas Lüke
CLEF 2012 Evaluation Labs and Workshop, Online Working Notes, Rome, Italy, September 17-20, 2012

doi dblp
Better than Their Reputation? On the Reliability of Relevance Assessments with Students
Philipp Schaer
Information Access Evaluation. Multilinguality, Multimodality, and Visual Analytics - Third International Conference of the CLEF Initiative, CLEF 2012, Rome, Italy, September 17-20, 2012. Proceedings

doi dblp
Integrating Interactive Visualizations in the Search Process of Digital Libraries and IR Systems
Daniel Hienert | Frank Sawitzki | Philipp Schaer | Philipp Mayr
Advances in Information Retrieval - 34th European Conference on IR Research, ECIR 2012, Barcelona, Spain, April 1-5, 2012. Proceedings

Search