Ian Soboroff

2025

doi dblp
Report from the 4th Strategic Workshop on Information Retrieval in Lorne (SWIRL 2025).
Johanne R. Trippas|J. Shane Culpepper|Mohammad Aliannejadi|James Allan|Enrique Amigó|Jaime Arguello|Leif Azzopardi|Peter Bailey|Jamie Callan|Rob Capra|Nick Craswell|W. Bruce Croft|Jeff Dalton|Gianluca Demartini|Laura Dietz|Zhicheng Dou|Carsten Eickhoff|Michael D. Ekstrand|Nicola Ferro|Norbert Fuhr|Dorota Glowacka|Faegheh Hasibi|Danula Hettiachchi|Rosie Jones|Jaap Kamps|Noriko Kando|Sarvnaz Karimi|Makoto P. Kato|Bevan Koopman|Yiqun Liu|Chenglong Ma|Joel Mackenzie|Maria Maistro|Jiaxin Mao|Dana McKay|Bhaskar Mitra|Stefano Mizzaro|Alistair Moffat|Josiane Mothe|Iadh Ounis|Lida Rashidi|Yongli Ren|Mark Sanderson|Rodrygo L. T. Santos|Falk Scholer|Chirag Shah|Laurianne Sitbon|Ian Soboroff|Damiano Spina|Paul Thomas|Julián Urbano|Arjen P. de Vries|Ryen White|Abby Yuan|Hamed Zamani|Oleg Zendel|Min Zhang|Shengyao Zhuang|Justin Zobel|Guido Zuccon
SIGIR Forum 2025 Volume 59 Issue 1
doi dblp
The Second Search Futures Workshop at ECIR'25.
Charles Clarke|Paul B. Kantor|Adam Roegiest|Ian Soboroff|Johanne R. Trippas|Zhaochun Ren
Advances in Information Retrieval - 47th European Conference on Information Retrieval, ECIR 2025, Lucca, Italy, April 6-10, 2025, Proceedings, Part V
doi dblp
A Large-Scale Study of Relevance Assessments with Large Language Models Using UMBRELA.
Shivani Upadhyay|Ronak Pradeep|Nandan Thakur|Daniel Campos|Nick Craswell|Ian Soboroff|Jimmy Lin
Proceedings of the 2025 International ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval, ICTIR 2025, Padua, Italy, 18 July 2025
doi dblp
The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models.
Ronak Pradeep|Nandan Thakur|Shivani Upadhyay|Daniel Campos|Nick Craswell|Ian Soboroff|Hoa Trang Dang|Jimmy Lin
Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025
doi dblp
LLM-Assisted Relevance Assessments: When Should We Ask LLMs for Help?
Rikiya Takehi|Ellen M. Voorhees|Tetsuya Sakai|Ian Soboroff
Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025
doi dblp
Assessing Support for the TREC 2024 RAG Track: A Large-Scale Comparative Study of LLM and Human Evaluations.
Nandan Thakur|Ronak Pradeep|Shivani Upadhyay|Daniel Campos|Nick Craswell|Ian Soboroff|Hoa Trang Dang|Jimmy Lin
Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025
doi dblp
Nugget-based Annotation Protocol and Tool For Evaluating Long-form Retrieval-Augmented Generation.
Eugene Yang|Dawn J. Lawrie|Hoa Dang|Ian Soboroff|James Mayfield
Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025

2024

dblp
Proceedings of the Thirty-Third Text REtrieval Conference, TREC 2024, Gaithersburg, MD, USA, November 18-22, 2024
Text Retrieval Conference (TREC) 2024
doi dblp
Report on the Search Futures Workshop at ECIR 2024.
Leif Azzopardi|Charles L. A. Clarke|Paul B. Kantor|Bhaskar Mitra|Johanne R. Trippas|Zhaochun Ren|Mohammad Aliannejadi|Negar Arabzadeh|Raman Chandrasekar|Maarten de Rijke|Panagiotis Eustratiadis|William R. Hersh|Jin Huang|Evangelos Kanoulas|Jasmin Kareem|Yongkang Li|Simon Lupart|Kidist Amde Mekonnen|Adam Roegiest|Ian Soboroff|Fabrizio Silvestri|Suzan Verberne|David Vos|Eugene Yang|Yuyue Zhao
SIGIR Forum 2024 Volume 58 Issue 1
doi dblp
Browsing and Searching Metadata of TREC.
Timo Breuer|Ellen M. Voorhees|Ian Soboroff
Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2024, Washington DC, USA, July 14-18, 2024
doi dblp
On the Evaluation of Machine-Generated Reports.
James Mayfield|Eugene Yang|Dawn J. Lawrie|Sean MacAvaney|Paul McNamee|Douglas W. Oard|Luca Soldaini|Ian Soboroff|Orion Weller|Efsun Selin Kayi|Kate Sanders|Marc Mason|Noah Hibbler
Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2024, Washington DC, USA, July 14-18, 2024

2023

dblp
The Thirty-Second Text REtrieval Conference Proceedings (TREC 2023), Gaithersburg, MD, USA, November 14-17, 2023
Text Retrieval Conference (TREC) 2023
dblp
TREC.
Ian Soboroff
Proceedings of the 17th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR 2023, Tokyo, Japan, December 12-15, 2023
doi dblp
Overview of the NTCIR-17 FairWeb-1 Task.
Sijie Tao|Nuo Chen|Tetsuya Sakai|Zhumin Chu|Hiromi Arai|Ian Soboroff|Nicola Ferro|Maria Maistro
Proceedings of the 17th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR 2023, Tokyo, Japan, December 12-15, 2023
doi dblp
The BETTER Cross-Language Datasets.
Ian Soboroff
Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2023, Taipei, Taiwan, July 23-27, 2023
dblp
Overview of the TREC 2023 Deep Learning Track.
Nick Craswell|Bhaskar Mitra|Emine Yilmaz|Hossein A. Rahmani|Daniel Campos|Jimmy Lin|Ellen M. Voorhees|Ian Soboroff
The Thirty-Second Text REtrieval Conference Proceedings (TREC 2023), Gaithersburg, MD, USA, November 14-17, 2023
dblp
Overview of TREC 2023.
Ian Soboroff
The Thirty-Second Text REtrieval Conference Proceedings (TREC 2023), Gaithersburg, MD, USA, November 14-17, 2023

2022

dblp
Proceedings of the Thirty-First Text REtrieval Conference, TREC 2022, online, November 15-19, 2022
Text Retrieval Conference (TREC) 2022
doi dblp
Report on the 1st Workshop on Audio Collection Human Interaction (AudioCHI 2022) at CHIIR 2022.
Gareth J. F. Jones|Maria Eskevich|Ben Carterette|Joana Correia|Rosie Jones|Jussi Karlgren|Ian Soboroff
SIGIR Forum 2022 Volume 56 Issue 1
doi dblp
CHIIR Workshop on Audio Collection Human Interaction (AudioCHI 2022): http: //speechretrievalworkshop.github.io.
Gareth J. F. Jones|Maria Eskevich|Ben Carterette|Joana Correia|Rosie Jones|Jussi Karlgren|Ian Soboroff
CHIIR '22: ACM SIGIR Conference on Human Information Interaction and Retrieval, Regensburg, Germany, March 14 - 18, 2022
dblp
Overview of the NTCIR-16 We Want Web with CENTRE (WWW-4) Task.
Tetsuya Sakai|Sijie Tao|Zhumin Chu|Maria Maistro|Yujing Li|Nuo Chen|Nicola Ferro|Junjie Wang|Ian Soboroff|Yiqun Liu
Proceedings of the 16th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR 2022, Tokyo, Japan, June 14-17, 2022
doi dblp
What Makes a Good Podcast Summary?
Rezvaneh Rezapour|Sravana Reddy|Rosie Jones|Ian Soboroff
SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022
dblp
Overview of the TREC 2022 Deep Learning Track.
Nick Craswell|Bhaskar Mitra|Emine Yilmaz|Daniel Campos|Jimmy Lin|Ellen M. Voorhees|Ian Soboroff
Proceedings of the Thirty-First Text REtrieval Conference, TREC 2022, online, November 15-19, 2022

2021

dblp
Proceedings of the Thirtieth Text REtrieval Conference, TREC 2021, online, November 15-19, 2021
Text Retrieval Conference (TREC) 2021
doi dblp
Podcast Metadata and Content: Episode Relevance and Attractiveness in Ad Hoc Search.
Ben Carterette|Rosie Jones|Gareth J. F. Jones|Maria Eskevich|Sravana Reddy|Ann Clifton|Yongze Yu|Jussi Karlgren|Ian Soboroff
SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021
doi dblp
TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime.
Nick Craswell|Bhaskar Mitra|Emine Yilmaz|Daniel Campos|Ellen M. Voorhees|Ian Soboroff
SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021
dblp
Overview of TREC 2021.
Ian Soboroff
Proceedings of the Thirtieth Text REtrieval Conference, TREC 2021, online, November 15-19, 2021

2020

doi dblp
TREC-COVID: constructing a pandemic information retrieval test collection.
Ellen M. Voorhees|Tasmeer Alam|Steven Bedrick|Dina Demner-Fushman|William R. Hersh|Kyle Lo|Kirk Roberts|Ian Soboroff|Lucy Lu Wang
SIGIR Forum 2020 Volume 54 Issue 1
doi dblp
HLVU: A New Challenge to Test Deep Understanding of Movies the Way Humans do.
Keith Curtis|George Awad|Shahzad Rajput|Ian Soboroff
Proceedings of the 2020 on International Conference on Multimedia Retrieval, ICMR 2020, Dublin, Ireland, June 8-11, 2020.
dblp
Overview of the NTCIR-15 We Want Web with CENTRE (WWW-3) Task.
Tetsuya Sakai|Sijie Tao|Zhaohao Zeng|Yukun Zheng|Jiaxin Mao|Zhumin Chu|Yiqun Liu|Maria Maistro|Zhicheng Dou|Nicola Ferro|Ian Soboroff
Proceedings of the 15th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR 2020, Tokyo, Japan, December 8-11, 2020
doi dblp
How to Measure the Reproducibility of System-oriented IR Experiments.
Craig Macdonald|Timo Breuer|Timo Breuer|Craig Macdonald|Nicola Ferro|Norbert Fuhr|Maria Maistro|Tetsuya Sakai|Philipp Schaer|Ian Soboroff
Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25-30, 2020
dblp
Incident Streams 2020: TRECIS in the Time of COVID-19.
Cody Buntain|Richard McCreadie|Ian Soboroff
Proceedings of the Twenty-Ninth Text REtrieval Conference, TREC 2020, Virtual Event [Gaithersburg, Maryland, USA], November 16-20, 2020.
dblp
TREC 2020 News Track Overview.
Ian Soboroff|Shudong Huang|Donna Harman
Proceedings of the Twenty-Ninth Text REtrieval Conference, TREC 2020, Virtual Event [Gaithersburg, Maryland, USA], November 16-20, 2020.

2019

doi dblp
On enhancing the robustness of timeline summarization test collections.
Richard McCreadie|Shahzad Rajput|Ian Soboroff|Craig Macdonald|Iadh Ounis
Information Processing and Management 2019 Volume 56 Issue 5
doi dblp
Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm.
Nicola Ferro|Norbert Fuhr|Maria Maistro|Tetsuya Sakai|Ian Soboroff
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Lugano, Switzerland, September 9-12, 2019, Proceedings
dblp
CENTRE@CLEF2019: Overview of the Replicability and Reproducibility Tasks.
Nicola Ferro|Norbert Fuhr|Maria Maistro|Tetsuya Sakai|Ian Soboroff
Working Notes of CLEF 2019 - Conference and Labs of the Evaluation Forum, Lugano, Switzerland, September 9-12, 2019.
doi dblp
CENTRE@CLEF 2019.
Nicola Ferro|Norbert Fuhr|Maria Maistro|Tetsuya Sakai|Ian Soboroff
Advances in Information Retrieval - 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14-18, 2019, Proceedings, Part II
dblp
Overview of the NTCIR-14 CENTRE Task.
Tetsuya Sakai|Nicola Ferro|Ian Soboroff|Zhaohao Zeng|Peng Xiao|Maria Maistro
Proceedings of the 14th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR 2019, Tokyo, Japan, June 10-13, 2019

2018

doi dblp
The Dagstuhl Perspectives Workshop on Performance Modeling and Prediction.
Nicola Ferro|Norbert Fuhr|Gregory Grefenstette|Joseph A. Konstan|Pablo Castells|Elizabeth M. Daly|Thierry Declerck|Michael D. Ekstrand|Werner Geyer|Julio Gonzalo|Tsvi Kuflik|Krister Lindén|Bernardo Magnini|Jian-Yun Nie|Raffaele Perego|Bracha Shapira|Ian Soboroff|Nava Tintarev|Karin Verspoor|Martijn C. Willemsen|Justin Zobel
SIGIR Forum 2018 Volume 52 Issue 1
doi dblp
Report on EVIA 2017.
Nicola Ferro|Ian Soboroff
SIGIR Forum 2018 Volume 52 Issue 1
doi dblp
Report on GLARE 2018: 1st Workshop on Generalization in Information Retrieval.
Ian Soboroff|Nicola Ferro|Norbert Fuhr
SIGIR Forum 2018 Volume 52 Issue 2
doi dblp
Meta-Analysis for Retrieval Experiments Involving Multiple Test Collections.
Ian Soboroff
Proceedings of the 27th ACM International Conference on Information and Knowledge Management, CIKM 2018, Torino, Italy, October 22-26, 2018
doi dblp
Overview of CENTRE@CLEF 2018: A First Tale in the Systematic Reproducibility Realm.
Nicola Ferro|Maria Maistro|Tetsuya Sakai|Ian Soboroff
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Avignon, France, September 10-14, 2018, Proceedings
dblp
CENTRE@CLEF2018: Overview of the Replicability Task.
Nicola Ferro|Maria Maistro|Tetsuya Sakai|Ian Soboroff
Working Notes of CLEF 2018 - Conference and Labs of the Evaluation Forum, Avignon, France, September 10-14, 2018.
dblp
TREC 2018 News Track Overview.
Ian Soboroff|Shudong Huang|Donna Harman
Proceedings of the Twenty-Seventh Text REtrieval Conference, TREC 2018, Gaithersburg, Maryland, USA, November 14-16, 2018

2017

doi dblp
Using Replicates in Information Retrieval Evaluation.
Ellen M. Voorhees|Daniel Samarov|Ian Soboroff
ACM Transactions on Information Systems (TOIS) 2017 Volume 36 Issue 2
dblp
New Tracks for TREC 2018.
Ian Soboroff
The 13th NTCIR Conference, Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, December 5-8, 2017
doi dblp
Building Test Collections: An Interactive Guide for Students and Others Without Their Own Evaluation Conference Series.
Ian Soboroff
Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7-11, 2017
dblp
TREC 2017 Dynamic Domain Track Overview.
Grace Hui Yang|Zhiwen Tang|Ian Soboroff
Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017

2016

dblp
News from TREC.
Ian Soboroff
Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, June 7-10, 2016
doi dblp
The BOLT IR Test Collections of Multilingual Passage Retrieval from Discussion Forums.
Ian Soboroff|Kira Griffitt|Stephanie M. Strassel
Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy, July 17-21, 2016
doi dblp
Privacy-Preserving IR 2016: Differential Privacy, Search, and Social Media.
Grace Hui Yang|Ian Soboroff|Li Xiong|Charles L. A. Clarke|Simson L. Garfinkel
Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy, July 17-21, 2016
dblp
TREC 2016 Dynamic Domain Track Overview.
Grace Hui Yang|Ian Soboroff
Proceedings of The Twenty-Fifth Text REtrieval Conference, TREC 2016, Gaithersburg, Maryland, USA, November 15-18, 2016

2015

doi dblp
Privacy Preserving IR 2015: A SIGIR 2015 Workshop.
Grace Hui Yang|Ian Soboroff
SIGIR Forum 2015 Volume 49 Issue 2
doi dblp
Privacy-Preserving IR 2015: When Information Retrieval Meets Privacy and Security.
Hui Yang|Ian Soboroff
Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile, August 9-13, 2015
dblp
TREC 2015 Dynamic Domain Track Overview.
Hui Yang|John R. Frank|Ian Soboroff
Proceedings of The Twenty-Fourth Text REtrieval Conference, TREC 2015, Gaithersburg, Maryland, USA, November 17-20, 2015

2014

dblp
Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, CIKM 2014, Shanghai, China, November 3-7, 2014
International Conference on Information and Knowledge Management (CIKM) 2014
dblp
Evaluating Stream Filtering for Entity Profile Updates in TREC 2012, 2013, and 2014.
John R. Frank|Max Kleiman-Weiner|Daniel A. Roberts|Ellen M. Voorhees|Ian Soboroff
Proceedings of The Twenty-Third Text REtrieval Conference, TREC 2014, Gaithersburg, Maryland, USA, November 19-21, 2014

2013

doi dblp
Introduction to the special issue on search intents and diversification.
Tetsuya Sakai|Noriko Kando|Craig Macdonald|Ian Soboroff
Discover Computing 2013 Volume 16 Issue 4
doi dblp
Building test collections: an interactive tutorial for students and others without their own evaluation conference series.
Ian Soboroff
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013
dblp
Evaluating Stream Filtering for Entity Profile Updates for TREC 2013.
John R. Frank|Steven J. Bauer|Max Kleiman-Weiner|Daniel A. Roberts|Nilesh Tripuraneni|Ce Zhang|Christopher Ré|Ellen M. Voorhees|Ian Soboroff
Proceedings of The Twenty-Second Text REtrieval Conference, TREC 2013, Gaithersburg, Maryland, USA, November 19-22, 2013

2012

doi dblp
Information Retrieval on the Blogosphere.
Rodrygo L. T. Santos|Craig Macdonald|Richard McCreadie|Iadh Ounis|Ian Soboroff
Foundations and Trends in Information Retrieval 2012 Volume 6 Issue 1
doi dblp
On building a reusable Twitter corpus.
Richard McCreadie|Ian Soboroff|Jimmy Lin|Craig Macdonald|Iadh Ounis|Dean McCullough
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012
dblp
Building an Entity-Centric Stream Filtering Test Collection for TREC 2012.
John R. Frank|Max Kleiman-Weiner|Daniel A. Roberts|Feng Niu|Ce Zhang|Christopher Ré|Ian Soboroff
Proceedings of The Twenty-First Text REtrieval Conference, TREC 2012, Gaithersburg, Maryland, USA, November 6-9, 2012
dblp
Overview of the TREC-2012 Microblog Track.
Ian Soboroff|Iadh Ounis|Craig Macdonald|Jimmy Lin
Proceedings of The Twenty-First Text REtrieval Conference, TREC 2012, Gaithersburg, Maryland, USA, November 6-9, 2012

2011

dblp
Overview of the TREC 2011 Web Track.
Charles L. A. Clarke|Nick Craswell|Ian Soboroff|Ellen M. Voorhees
Proceedings of The Twentieth Text REtrieval Conference, TREC 2011, Gaithersburg, Maryland, USA, November 15-18, 2011
dblp
Overview of the TREC 2011 Microblog Track.
Iadh Ounis|Craig Macdonald|Jimmy Lin|Ian Soboroff
Proceedings of The Twentieth Text REtrieval Conference, TREC 2011, Gaithersburg, Maryland, USA, November 15-18, 2011
doi dblp
A comparative analysis of cascade measures for novelty and diversity.
Charles L. A. Clarke|Nick Craswell|Ian Soboroff|Azin Ashkan
Proceedings of the Forth International Conference on Web Search and Web Data Mining, WSDM 2011, Hong Kong, China, February 9-12, 2011

2010

doi dblp
Blog track research at TREC.
Craig Macdonald|Rodrygo L. T. Santos|Iadh Ounis|Ian Soboroff
SIGIR Forum 2010 Volume 44 Issue 1
doi dblp
The effect of assessor error on IR system evaluation.
Ben Carterette|Ian Soboroff
Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2010, Geneva, Switzerland, July 19-23, 2010
dblp
Overview of the TREC 2010 Web Track.
Charles L. A. Clarke|Nick Craswell|Ian Soboroff|Gordon V. Cormack
Proceedings of The Nineteenth Text REtrieval Conference, TREC 2010, Gaithersburg, Maryland, USA, November 16-19, 2010
dblp
Overview of the TREC 2010 Blog Track.
Iadh Ounis|Ian Soboroff
Proceedings of The Nineteenth Text REtrieval Conference, TREC 2010, Gaithersburg, Maryland, USA, November 16-19, 2010

2009

doi dblp
The search and social media workshop at SIGIR 2009.
Eugene Agichtein|Marti A. Hearst|Ian Soboroff
SIGIR Forum 2009 Volume 43 Issue 2
doi dblp
A guide to the RIA workshop data archive.
Ian Soboroff
Discover Computing 2009 Volume 12 Issue 6
doi dblp
Is spam an issue for opinionated blog post search?
Craig Macdonald|Iadh Ounis|Ian Soboroff
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, July 19-23, 2009
dblp
Overview of the TREC 2009 Web Track.
Charles L. A. Clarke|Nick Craswell|Ian Soboroff
Proceedings of The Eighteenth Text REtrieval Conference, TREC 2009, Gaithersburg, Maryland, USA, November 17-20, 2009
dblp
Overview of the TREC 2009 Blog Track.
Craig Macdonald|Iadh Ounis|Ian Soboroff
Proceedings of The Eighteenth Text REtrieval Conference, TREC 2009, Gaithersburg, Maryland, USA, November 17-20, 2009

2008

dblp
Proceeding of the 2008 ACM Workshop on Search in Social Media, SSM 2008, Napa Valley, California, USA, October 30, 2008
International Conference on Information and Knowledge Management (CIKM) 2008
dblp
TREC, TAC, takeoffs, tacks, tasks, and titillations for 2009.
Ian Soboroff
Proceedings of the 7th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-7, National Center of Sciences, Tokyo, Japan, December 16-19, 2008
doi dblp
Relevance assessment: are judges exchangeable and does it matter.
Peter Bailey|Nick Craswell|Ian Soboroff|Paul Thomas|Arjen P. de Vries|Emine Yilmaz
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, Singapore, July 20-24, 2008
doi dblp
Limits of opinion-finding baseline systems.
Craig Macdonald|Ben He|Iadh Ounis|Ian Soboroff
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, Singapore, July 20-24, 2008
dblp
Overview of the TREC 2008 Enterprise Track.
Krisztian Balog|Ian Soboroff|Paul Thomas|Peter Bailey|Nick Craswell|Arjen P. de Vries
Proceedings of The Seventeenth Text REtrieval Conference, TREC 2008, Gaithersburg, Maryland, USA, November 18-21, 2008
dblp
Overview of the TREC 2008 Blog Track.
Iadh Ounis|Craig MacDonald|Ian Soboroff
Proceedings of The Seventeenth Text REtrieval Conference, TREC 2008, Gaithersburg, Maryland, USA, November 18-21, 2008

2007

doi dblp
The CSIRO enterprise search test collection.
Peter Bailey|Nick Craswell|Ian Soboroff|Arjen P. de Vries
SIGIR Forum 2007 Volume 41 Issue 2
doi dblp
Bias and the limits of pooling for large collections.
Chris Buckley|Darrin Dimmick|Ian Soboroff|Ellen M. Voorhees
Discover Computing 2007 Volume 10 Issue 6
dblp
What's New at TREC: Blog and Legal Discovery Search at TREC-2006.
Ian Soboroff
Proceedings of the 6th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-6, National Center of Sciences, Tokyo, Japan, May 15-18, 2007
doi dblp
Reliable information retrieval evaluation with incomplete and biased judgements.
Stefan Büttcher|Charles L. A. Clarke|Peter C. K. Yeung|Ian Soboroff
SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands, July 23-27, 2007
doi dblp
Problems with Kendall's tau.
Mark Sanderson|Ian Soboroff
SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands, July 23-27, 2007
doi dblp
A comparison of pooled and sampled relevance judgments.
Ian Soboroff
SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands, July 23-27, 2007
dblp
Overview of the TREC 2007 Enterprise Track.
Peter Bailey|Arjen P. de Vries|Nick Craswell|Ian Soboroff
Proceedings of The Sixteenth Text REtrieval Conference, TREC 2007, Gaithersburg, Maryland, USA, November 5-9, 2007
dblp
Overview of the TREC 2007 Blog Track.
Craig Macdonald|Iadh Ounis|Ian Soboroff
Proceedings of The Sixteenth Text REtrieval Conference, TREC 2007, Gaithersburg, Maryland, USA, November 5-9, 2007

2006

doi dblp
Bias and the limits of pooling.
Chris Buckley|Darrin Dimmick|Ian Soboroff|Ellen M. Voorhees
SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6-11, 2006
doi dblp
Dynamic test collections: measuring search effectiveness on the live web.
Ian Soboroff
SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6-11, 2006
dblp
The TREC 2006 Terabyte Track.
Stefan Büttcher|Charles L. A. Clarke|Ian Soboroff
Proceedings of the Fifteenth Text REtrieval Conference, TREC 2006, Gaithersburg, Maryland, USA, November 14-17, 2006
dblp
Overview of the TREC 2006 Blog Track.
Iadh Ounis|Craig Macdonald|Maarten de Rijke|Gilad Mishne|Ian Soboroff
Proceedings of the Fifteenth Text REtrieval Conference, TREC 2006, Gaithersburg, Maryland, USA, November 14-17, 2006
dblp
Overview of the TREC 2006 Enterprise Track.
Ian Soboroff|Arjen P. de Vries|Nick Craswell
Proceedings of the Fifteenth Text REtrieval Conference, TREC 2006, Gaithersburg, Maryland, USA, November 14-17, 2006

2005

doi dblp
The TREC terabyte retrieval track.
Charles L. A. Clarke|Nick Craswell|Ian Soboroff
SIGIR Forum 2005 Volume 39 Issue 1
doi dblp
SIGIR workshop report: predicting query difficulty - methods and applications.
David Carmel|Elad Yom-Tov|Ian Soboroff
SIGIR Forum 2005 Volume 39 Issue 2
dblp
The TREC 2005 Terabyte Track.
Charles L. A. Clarke|Falk Scholer|Ian Soboroff
Proceedings of the Fourteenth Text REtrieval Conference, TREC 2005, Gaithersburg, Maryland, USA, November 15-18, 2005
dblp
Overview of the TREC 2005 Enterprise Track.
Nick Craswell|Arjen P. de Vries|Ian Soboroff
Proceedings of the Fourteenth Text REtrieval Conference, TREC 2005, Gaithersburg, Maryland, USA, November 15-18, 2005

2004

doi dblp
On evaluating web search with very few relevant documents.
Ian Soboroff
SIGIR 2004: Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Sheffield, UK, July 25-29, 2004
dblp
Overview of the TREC 2004 Terabyte Track.
Charles L. A. Clarke|Nick Craswell|Ian Soboroff
Proceedings of the Thirteenth Text REtrieval Conference, TREC 2004, Gaithersburg, Maryland, USA, November 16-19, 2004
dblp
Overview of the TREC 2004 Novelty Track.
Ian Soboroff
Proceedings of the Thirteenth Text REtrieval Conference, TREC 2004, Gaithersburg, Maryland, USA, November 16-19, 2004

2003

doi dblp
Summary of the SIGIR 2003 workshop on defining evaluation methodologies for terabyte-scale test collections.
Ian Soboroff|Ellen M. Voorhees|Nick Craswell
SIGIR Forum 2003 Volume 37 Issue 2
doi dblp
Building a filtering test collection for TREC 2002.
Ian Soboroff|Stephen E. Robertson
SIGIR 2003: Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, July 28 - August 1, 2003, Toronto, Canada
dblp
Overview of the TREC 2003 Novelty Track.
Ian Soboroff|Donna Harman
Proceedings of The Twelfth Text REtrieval Conference, TREC 2003, Gaithersburg, Maryland, USA, November 18-21, 2003

2002

doi dblp
Do TREC web collections look like the web?
Ian Soboroff
SIGIR Forum 2002 Volume 36 Issue 2
doi dblp
Related, but not Relevant: Content-Based Collaborative Filtering in TREC-8.
Ian Soboroff|Charles K. Nicholas
Discover Computing 2002 Volume 5 Issue 2-3
doi dblp
Automatic evaluation of world wide web search services.
Abdur Chowdhury|Ian Soboroff
SIGIR 2002: Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, August 11-15, 2002, Tampere, Finland
doi dblp
Does WT10g look like the web?.
Ian Soboroff
SIGIR 2002: Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, August 11-15, 2002, Tampere, Finland
dblp
The TREC 2002 Filtering Track Report.
Stephen E. Robertson|Ian Soboroff
Proceedings of The Eleventh Text REtrieval Conference, TREC 2002, Gaithersburg, Maryland, USA, November 19-22, 2002

2001

doi dblp
Ranking Retrieval Systems without Relevance Judgments.
Ian Soboroff|Charles K. Nicholas|Patrick Cahan
SIGIR 2001: Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, September 9-13, 2001, New Orleans, Louisiana, USA
dblp
The TREC 2001 Filtering Track Report.
Stephen E. Robertson|Ian Soboroff
Proceedings of The Tenth Text REtrieval Conference, TREC 2001, Gaithersburg, Maryland, USA, November 13-16, 2001

2000

doi dblp
Collaborative filtering and the generalized vector space model.
Ian Soboroff|Charles K. Nicholas
SIGIR 2000: Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, July 24-28, 2000, Athens, Greece

1999

doi dblp
Workshop on Recommender Systems: Algorithms and Evaluation.
Ian Soboroff|Charles K. Nicholas|Michael J. Pazzani
SIGIR Forum 1999 Volume 33 Issue 1
dblp
TREC-8 Experiments at Maryland: CLIR, QA and Routing.
Douglas W. Oard|Jianqiang Wang|Dekang Lin|Ian Soboroff
Proceedings of The Eighth Text REtrieval Conference, TREC 1999, Gaithersburg, Maryland, USA, November 17-19, 1999

1997

doi dblp
Visualizing Document Authorship Using n-grams and Latent Semantic Indexing.
Ian Soboroff|Charles K. Nicholas|James M. Kukla|David S. Ebert
Proceedings of the Workshop on New Paradigms in Information Visualization and Manipulation, NIPV 1997, in conjuction with CIKM 1997, November 10-14, 1997, Las Vegas, NV, USA