Ben Carterette
2022
Report on the 1st Workshop on Audio Collection Human Interaction (AudioCHI 2022) at CHIIR 2022
Gareth J. F. Jones
|
Maria Eskevich
|
Ben Carterette
|
Joana Correia
|
Rosie Jones
|
Jussi Karlgren
|
Ian Soboroff
2022 Volume 56 Issue 1
Chair's Letter
Ben Carterette
2022 Volume 56 Issue 1
SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022
SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022
CHIIR Workshop on Audio Collection Human Interaction (AudioCHI 2022): http: //speechretrievalworkshop.github.io
Gareth J. F. Jones
|
Maria Eskevich
|
Ben Carterette
|
Joana Correia
|
Rosie Jones
|
Jussi Karlgren
|
Ian Soboroff
CHIIR '22: ACM SIGIR Conference on Human Information Interaction and Retrieval, Regensburg, Germany, March 14 - 18, 2022
Using Survival Models to Estimate User Engagement in Online Experiments
Praveen Chandar
|
Brian St. Thomas
|
Lucas Maystre
|
Vijay Pappu
|
Roberto Sanchis-Ojeda
|
Tiffany Wu
|
Ben Carterette
|
Mounia Lalmas
|
Tony Jebara
WWW '22: The ACM Web Conference 2022, Virtual Event, Lyon, France, April 25 - 29, 2022
2021
Chair's letter
Ben Carterette
2021 Volume 55 Issue 2
How Am I Doing?: Evaluating Conversational Search Systems Offline
Aldo Lipani
|
Ben Carterette
|
Emine Yilmaz
2021 Volume 39 Issue 4
Podcast Metadata and Content: Episode Relevance and Attractiveness in Ad Hoc Search
Ben Carterette
|
Rosie Jones
|
Gareth J. F. Jones
|
Maria Eskevich
|
Sravana Reddy
|
Ann Clifton
|
Yongze Yu
|
Jussi Karlgren
|
Ian Soboroff
SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021
Current Challenges and Future Directions in Podcast Information Access
Rosie Jones
|
Hamed Zamani
|
Markus Schedl
|
Ching-Wei Chen
|
Sravana Reddy
|
Ann Clifton
|
Jussi Karlgren
|
Helia Hashemi
|
Aasish Pappu
|
Zahra Nazari
|
Longqi Yang
|
Oguz Semerci
|
Hugues Bouchard
|
Ben Carterette
SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021
Estimation of Fair Ranking Metrics with Incomplete Judgments
Ömer Kirnap
|
Fernando Diaz
|
Asia Biega
|
Michael D. Ekstrand
|
Ben Carterette
|
Emine Yilmaz
WWW '21: The Web Conference 2021, Virtual Event / Ljubljana, Slovenia, April 19-23, 2021
2020
Report on the 2nd ACM SIGIR/SIGKDD Africa school on machine learning for data mining and search
Tanya Y. Berger-Wolf
|
Ben Carterette
|
Tamer Elsayed
|
C. Maria Keet
|
Fabrizio Sebastiani
|
Hussein Suleman
2020 Volume 54 Issue 1
TREC 2020 Podcasts Track Overview
Rosie Jones
|
Ben Carterette
|
Ann Clifton
|
Jussi Karlgren
|
Aasish Pappu
|
Sravana Reddy
|
Yongze Yu
|
Maria Eskevich
|
Gareth J. F. Jones
Proceedings of the Twenty-Ninth Text REtrieval Conference, TREC 2020, Virtual Event [Gaithersburg, Maryland, USA], November 16-20, 2020
Recommending Podcasts for Cold-Start Users Based on Music Listening and Taste
Zahra Nazari
|
Christophe Charbuillet
|
Johan Pages
|
Martin Laurent
|
Denis Charrier
|
Briana Vecchione
|
Ben Carterette
Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25-30, 2020
Bayesian Inferential Risk Evaluation On Multiple IR Systems
Rodger Benham
|
Ben Carterette
|
J. Shane Culpepper
|
Alistair Moffat
Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25-30, 2020
Evaluating Stochastic Rankings with Expected Exposure
Fernando Diaz
|
Bhaskar Mitra
|
Michael D. Ekstrand
|
Asia J. Biega
|
Ben Carterette
CIKM '20: The 29th ACM International Conference on Information and Knowledge Management, Virtual Event, Ireland, October 19-23, 2020
Leveraging Behavioral Heterogeneity Across Markets for Cross-Market Training of Recommender Systems
Kevin Roitero
|
Ben Carterette
|
Rishabh Mehrotra
|
Mounia Lalmas
Companion of The 2020 Web Conference 2020, Taipei, Taiwan, April 20-24, 2020
2019
Report on the 1st ACM SIGIR/SIGKDD Africa School on Machine Learning for Data Mining and Search
Ben Carterette
|
Hussein Suleman
|
Douglas W. Oard
2019 Volume 53 Issue 1
Offline Evaluation to Make Decisions About PlaylistRecommendation Algorithms
Alois Gruson
|
Praveen Chandar
|
Christophe Charbuillet
|
James McInerney
|
Samantha Hansen
|
Damien Tardieu
|
Ben Carterette
Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, WSDM 2019, Melbourne, VIC, Australia, February 11-15, 2019
Taking Risks with Confidence
Rodger Benham
|
Ben Carterette
|
Alistair Moffat
|
J. Shane Culpepper
Proceedings of the 24th Australasian Document Computing Symposium, ADCS 2019, Sydney, Australia, December 5-6, 2019
Statistical Significance Testing in Theory and in Practice
Ben Carterette
Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2019, Santa Clara, CA, USA, October 2-5, 2019
From a User Model for Query Sessions to Session Rank Biased Precision (sRBP)
Aldo Lipani
|
Ben Carterette
|
Emine Yilmaz
Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2019, Santa Clara, CA, USA, October 2-5, 2019
Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2019, Santa Clara, CA, USA, October 2-5, 2019
Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2019, Santa Clara, CA, USA, October 2-5, 2019
2018
Offline Comparative Evaluation with Incremental, Minimally-Invasive Online Feedback
Ben Carterette
|
Praveen Chandar
The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA, July 08-12, 2018
Estimating Clickthrough Bias in the Cascade Model
Praveen Chandar
|
Ben Carterette
Proceedings of the 27th ACM International Conference on Information and Knowledge Management, CIKM 2018, Torino, Italy, October 22-26, 2018
2017
TREC 2017 Tasks Track Overview
Evangelos Kanoulas
|
Emine Yilmaz
|
Rishabh Mehrotra
|
Ben Carterette
|
Nick Craswell
|
Peter Bailey
Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017
Statistical Significance Testing in Information Retrieval: Theory and Practice
Ben Carterette
Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7-11, 2017
But Is It Statistically Significant?: Statistical Significance in IR Research, 1995-2014
Ben Carterette
Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7-11, 2017
User Click Detection in Ideal Sessions
Mustafa Zengin
|
Ben Carterette
Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval, CHIIR 2017, Oslo, Norway, March 7-11, 2017
2016
Information retrieval evaluation using test collections
Falk Scholer
|
Diane Kelly
|
Ben Carterette
2016 Volume 19 Issue 3
Overview of the TREC Tasks Track 2016
Manisha Verma
|
Emine Yilmaz
|
Rishabh Mehrotra
|
Evangelos Kanoulas
|
Ben Carterette
|
Nick Craswell
|
Peter Bailey
Proceedings of The Twenty-Fifth Text REtrieval Conference, TREC 2016, Gaithersburg, Maryland, USA, November 15-18, 2016
PDF: A Probabilistic Data Fusion Framework for Retrieval and Ranking
Ashraf Bah Rabiou
|
Ben Carterette
Proceedings of the 2016 ACM on International Conference on the Theory of Information Retrieval, ICTIR 2016, Newark, DE, USA, September 12- 6, 2016
Proceedings of the 2016 ACM on International Conference on the Theory of Information Retrieval, ICTIR 2016, Newark, DE, USA, September 12- 6, 2016
Proceedings of the 2016 ACM on International Conference on the Theory of Information Retrieval, ICTIR 2016, Newark, DE, USA, September 12- 6, 2016
Reformulate or Quit: Predicting User Abandonment in Ideal Sessions
Mustafa Zengin
|
Ben Carterette
Information Retrieval Technology - 12th Asia Information Retrieval Societies Conference, AIRS 2016, Beijing, China, November 30 - December 2, 2016, Proceedings
Evaluating Retrieval over Sessions: The TREC Session Track 2011-2014
Ben Carterette
|
Paul D. Clough
|
Mark M. Hall
|
Evangelos Kanoulas
|
Mark Sanderson
Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy, July 17-21, 2016
2015
Overview of the TREC 2015 Tasks Track
Emine Yilmaz
|
Manisha Verma
|
Rishabh Mehrotra
|
Evangelos Kanoulas
|
Ben Carterette
|
Nick Craswell
Proceedings of The Twenty-Fourth Text REtrieval Conference, TREC 2015, Gaithersburg, Maryland, USA, November 17-20, 2015
Dynamic Test Collections for Retrieval Evaluation
Ben Carterette
|
Ashraf Bah
|
Mustafa Zengin
Proceedings of the 2015 International Conference on The Theory of Information Retrieval, ICTIR 2015, Northampton, Massachusetts, USA, September 27-30, 2015
Bayesian Inference for Information Retrieval Evaluation
Ben Carterette
Proceedings of the 2015 International Conference on The Theory of Information Retrieval, ICTIR 2015, Northampton, Massachusetts, USA, September 27-30, 2015
Statistical Significance Testing in Information Retrieval: Theory and Practice
Ben Carterette
Proceedings of the 2015 International Conference on The Theory of Information Retrieval, ICTIR 2015, Northampton, Massachusetts, USA, September 27-30, 2015
Improving Ranking and Robustness of Search Systems by Exploiting the Popularity of Documents
Ashraf Bah
|
Ben Carterette
Information Retrieval Technology - 11th Asia Information Retrieval Societies Conference, AIRS 2015, Brisbane, QLD, Australia, December 2-4, 2015. Proceedings
The Best Published Result is Random: Sequential Testing and its Effect on Reported Effectiveness
Ben Carterette
Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile, August 9-13, 2015
Document Comprehensiveness and User Preferences in Novelty Search Tasks
Ashraf Bah
|
Praveen Chandar
|
Ben Carterette
Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile, August 9-13, 2015
Learning User Preferences for Topically Similar Documents
Mustafa Zengin
|
Ben Carterette
Proceedings of the 24th ACM International Conference on Information and Knowledge Management, CIKM 2015, Melbourne, VIC, Australia, October 19 - 23, 2015
2014
Seventh ACM International Conference on Web Search and Data Mining, WSDM 2014, New York, NY, USA, February 24-28, 2014
Seventh ACM International Conference on Web Search and Data Mining, WSDM 2014, New York, NY, USA, February 24-28, 2014
University of Delaware at TREC 2014
Ashraf Bah
|
Karankumar Sabhnani
|
Mustafa Zengin
|
Ben Carterette
Proceedings of The Twenty-Third Text REtrieval Conference, TREC 2014, Gaithersburg, Maryland, USA, November 19-21, 2014
Overview of the TREC 2014 Session Track
Ben Carterette
|
Evangelos Kanoulas
|
Mark M. Hall
|
Paul D. Clough
Proceedings of The Twenty-Third Text REtrieval Conference, TREC 2014, Gaithersburg, Maryland, USA, November 19-21, 2014
Udel @ NTCIR-11 MobileClick Track
Ashraf Bah Rabiou
|
Ben Carterette
Proceedings of the 11th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR-11, National Center of Sciences, Tokyo, Japan, December 9-12, 2014
Udel @ NTCIR-11 IMine Track
Ashraf Bah
|
Ben Carterette
|
Praveen Chandar
Proceedings of the 11th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR-11, National Center of Sciences, Tokyo, Japan, December 9-12, 2014
Aggregating Results from Multiple Related Queries to Improve Web Search over Sessions
Ashraf Bah
|
Ben Carterette
Information Retrieval Technology - 10th Asia Information Retrieval Societies Conference, AIRS 2014, Kuching, Malaysia, December 3-5, 2014. Proceedings
Statistical significance testing in information retrieval: theory and practice
Ben Carterette
The 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '14, Gold Coast , QLD, Australia - July 06 - 11, 2014
2013
An Incremental Approach for MEDLINE MeSH Indexing
Dongqing Zhu
|
Dingcheng Li
|
Ben Carterette
|
Hongfang Liu
Proceedings of the first Workshop on Bio-Medical Semantic Indexing and Question Answering, a Post-Conference Workshop of Conference and Labs of the Evaluation Forum 2013 (CLEF 2013) , Valencia, Spain, September 27th, 2013
Overview of the TREC 2013 Session Track
Ben Carterette
|
Ashraf Bah
|
Evangelos Kanoulas
|
Mark M. Hall
|
Paul D. Clough
Proceedings of The Twenty-Second Text REtrieval Conference, TREC 2013, Gaithersburg, Maryland, USA, November 19-22, 2013
Statistical Significance Testing in Information Retrieval: Theory and Practice
Ben Carterette
International Conference on the Theory of Information Retrieval, ICTIR '13, Copenhagen, Denmark, September 29 - October 02, 2013
An adaptive evidence weighting method for medical record search
Dongqing Zhu
|
Ben Carterette
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013
Document features predicting assessor disagreement
Praveen Chandar
|
William Webber
|
Ben Carterette
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013
Preference based evaluation measures for novelty and diversity
Praveen Chandar
|
Ben Carterette
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013
Using Discharge Summaries to Improve Information Retrieval in Clinical Domain
Dongqing Zhu
|
Stephen T. Wu
|
James J. Masanz
|
Ben Carterette
|
Hongfang Liu
Working Notes for CLEF 2013 Conference , Valencia, Spain, September 23-26, 2013
2012
Combining multi-level evidence for medical record retrieval
Dongqing Zhu
|
Ben Carterette
Proceedings of the 2012 International Workshop on Smart Health and Wellbeing, SHB 2012, October 29, 2012, Maui, HI, USA
Predicting baby feeding method from unstructured electronic health record data
Ashwani Rao
|
Kristin Maiden
|
Ben Carterette
|
Deb Ehrenthal
Proceedings of the ACM sixth international workshop on Data and text mining in biomedical informatics, DTMBIO@CIKM 2012, Maui, Hawaii, USA, October 29, 2012
Overview of the TREC 2012 Session Track
Evangelos Kanoulas
|
Ben Carterette
|
Mark M. Hall
|
Paul D. Clough
|
Mark Sanderson
Proceedings of The Twenty-First Text REtrieval Conference, TREC 2012, Gaithersburg, Maryland, USA, November 6-9, 2012
Exploring Evidence Aggregation Methods and External Expansion Sources for Medical Record Search
Dongqing Zhu
|
Ben Carterette
Proceedings of The Twenty-First Text REtrieval Conference, TREC 2012, Gaithersburg, Maryland, USA, November 6-9, 2012
Advances on the development of evaluation measures
Ben Carterette
|
Evangelos Kanoulas
|
Emine Yilmaz
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012
Using PageRank to infer user preferences
Praveen Chandar
|
Ben Carterette
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012
Using preference judgments for novel document retrieval
Praveen Chandar
|
Ben Carterette
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012
Incorporating variability in user behavior into systems based evaluation
Ben Carterette
|
Evangelos Kanoulas
|
Emine Yilmaz
21st ACM International Conference on Information and Knowledge Management, CIKM'12, Maui, HI, USA, October 29 - November 02, 2012
Alternative assessor disagreement and retrieval depth
William Webber
|
Praveen Chandar
|
Ben Carterette
21st ACM International Conference on Information and Knowledge Management, CIKM'12, Maui, HI, USA, October 29 - November 02, 2012
2011
Report on the ECIR 2011 workshop on information retrieval over query sessions
Ben Carterette
|
Paul D. Clough
|
Evangelos Kanoulas
|
Mark Sanderson
2011 Volume 45 Issue 2
An analysis of NP-completeness in novelty and diversity ranking
Ben Carterette
2011 Volume 14 Issue 1
Using Multiple External Collections for Query Expansion
Dongqing Zhu
|
Ben Carterette
Proceedings of The Twentieth Text REtrieval Conference, TREC 2011, Gaithersburg, Maryland, USA, November 15-18, 2011
Simple Rank-Based Filtering for Microblog Retrieval: Implications for Evaluation and Test Collections
Ben Carterette
|
Naveen Kumar
|
Ashwani Rao
|
Dongqing Zhu
Proceedings of The Twentieth Text REtrieval Conference, TREC 2011, Gaithersburg, Maryland, USA, November 15-18, 2011
Overview of the TREC 2011 Session Track
Evangelos Kanoulas
|
Mark M. Hall
|
Paul D. Clough
|
Ben Carterette
|
Mark Sanderson
Proceedings of The Twentieth Text REtrieval Conference, TREC 2011, Gaithersburg, Maryland, USA, November 15-18, 2011
Implicit Feedback and Document Filtering for Retrieval Over Query Sessions
Ben Carterette
|
Praveen Chandar
Proceedings of The Twentieth Text REtrieval Conference, TREC 2011, Gaithersburg, Maryland, USA, November 15-18, 2011
Model-Based Inference about IR Systems
Ben Carterette
Advances in Information Retrieval Theory - Third International Conference, ICTIR 2011, Bertinoro, Italy, September 12-14, 2011. Proceedings
Evaluating multi-query sessions
Evangelos Kanoulas
|
Ben Carterette
|
Paul D. Clough
|
Mark Sanderson
Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, July 25-29, 2011
System effectiveness, user models, and user utility: a conceptual framework for investigation
Ben Carterette
Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, July 25-29, 2011
Simulating simple user behavior for system effectiveness evaluation
Ben Carterette
|
Evangelos Kanoulas
|
Emine Yilmaz
Proceedings of the 20th ACM Conference on Information and Knowledge Management, CIKM 2011, Glasgow, United Kingdom, October 24-28, 2011
Within-Document Term-Based Index Pruning with Statistical Hypothesis Testing
Sree Lekha Thota
|
Ben Carterette
Advances in Information Retrieval - 33rd European Conference on IR Research, ECIR 2011, Dublin, Ireland, April 18-21, 2011. Proceedings
A Methodology for Evaluating Aggregated Search Results
Jaime Arguello
|
Fernando Diaz
|
Jamie Callan
|
Ben Carterette
Advances in Information Retrieval - 33rd European Conference on IR Research, ECIR 2011, Dublin, Ireland, April 18-21, 2011. Proceedings
2010
Measuring the reusability of test collections
Ben Carterette
|
Evgeniy Gabrilovich
|
Vanja Josifovski
|
Donald Metzler
Proceedings of the Third International Conference on Web Search and Web Data Mining, WSDM 2010, New York, NY, USA, February 4-6, 2010
Overview of the TREC 2010 Session Track
Evangelos Kanoulas
|
Paul D. Clough
|
Ben Carterette
|
Mark Sanderson
Proceedings of The Nineteenth Text REtrieval Conference, TREC 2010, Gaithersburg, Maryland, USA, November 16-19, 2010
Low cost evaluation in information retrieval
Ben Carterette
|
Evangelos Kanoulas
|
Emine Yilmaz
Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2010, Geneva, Switzerland, July 19-23, 2010
Diversification of search results using webgraphs
Praveen Chandar
|
Ben Carterette
Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2010, Geneva, Switzerland, July 19-23, 2010
Reusable test collections through experimental design
Ben Carterette
|
Evangelos Kanoulas
|
Virgiliu Pavlu
|
Hui Fang
Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2010, Geneva, Switzerland, July 19-23, 2010
The effect of assessor error on IR system evaluation
Ben Carterette
|
Ian Soboroff
Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2010, Geneva, Switzerland, July 19-23, 2010
2009
Redundancy, diversity and interdependent document relevance
Filip Radlinski
|
Paul N. Bennett
|
Ben Carterette
|
Thorsten Joachims
2009 Volume 43 Issue 2
Minimal Test Collections for Relevance Feedback
Ben Carterette
|
Praveen Chandar
|
Aparna Kailasam
|
Divya Muppaneni
|
Sree Lekha Thota
Proceedings of The Eighteenth Text REtrieval Conference, TREC 2009, Gaithersburg, Maryland, USA, November 17-20, 2009
Million Query Track 2009 Overview
Ben Carterette
|
Virgiliu Pavlu
|
Hui Fang
|
Evangelos Kanoulas
Proceedings of The Eighteenth Text REtrieval Conference, TREC 2009, Gaithersburg, Maryland, USA, November 17-20, 2009
Ad Hoc and Diversity Retrieval at the University of Delaware
Praveen Chandar
|
Aparna Kailasam
|
Divya Muppaneni
|
Sree Lekha Thota
|
Ben Carterette
Proceedings of The Eighteenth Text REtrieval Conference, TREC 2009, Gaithersburg, Maryland, USA, November 17-20, 2009
An Analysis of NP-Completeness in Novelty and Diversity Ranking
Ben Carterette
Advances in Information Retrieval Theory, Second International Conference on the Theory of Information Retrieval, ICTIR 2009, Cambridge, UK, September 10-12, 2009, Proceedings
Agreement among statistical significance tests for information retrieval evaluation at varying sample sizes
Mark D. Smucker
|
James Allan
|
Ben Carterette
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, July 19-23, 2009
On rank correlation and the distance between rankings
Ben Carterette
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, July 19-23, 2009
Probabilistic models of ranking novel documents for faceted topic retrieval
Ben Carterette
|
Praveen Chandar
Proceedings of the 18th ACM Conference on Information and Knowledge Management, CIKM 2009, Hong Kong, China, November 2-6, 2009
If I Had a Million Queries
Ben Carterette
|
Virgiliu Pavlu
|
Evangelos Kanoulas
|
Javed A. Aslam
|
James Allan
Advances in Information Retrieval, 31th European Conference on IR Research, ECIR 2009, Toulouse, France, April 6-9, 2009. Proceedings
2008
Beyond binary relevance: preferences, diversity, and set-level judgments
Paul N. Bennett
|
Ben Carterette
|
Olivier Chapelle
|
Thorsten Joachims
2008 Volume 42 Issue 2
Million Query Track 2008 Overview
James Allan
|
Javed A. Aslam
|
Virgil Pavlu
|
Evangelos Kanoulas
|
Ben Carterette
Proceedings of The Seventeenth Text REtrieval Conference, TREC 2008, Gaithersburg, Maryland, USA, November 18-21, 2008
Evaluation measures for preference judgments
Ben Carterette
|
Paul N. Bennett
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, Singapore, July 20-24, 2008
Evaluation over thousands of queries
Ben Carterette
|
Virgiliu Pavlu
|
Evangelos Kanoulas
|
Javed A. Aslam
|
James Allan
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, Singapore, July 20-24, 2008
Here or There
Ben Carterette
|
Paul N. Bennett
|
David Maxwell Chickering
|
Susan T. Dumais
Advances in Information Retrieval , 30th European Conference on IR Research, ECIR 2008, Glasgow, UK, March 30-April 3, 2008. Proceedings
2007
Million Query Track 2007 Overview
James Allan
|
Ben Carterette
|
Blagovest Dachev
|
Javed A. Aslam
|
Virgiliu Pavlu
|
Evangelos Kanoulas
Proceedings of The Sixteenth Text REtrieval Conference, TREC 2007, Gaithersburg, Maryland, USA, November 5-9, 2007
Research Methodology in Studies of Information Retrieval Evaluation
Ben Carterette
|
James Allan
Computer-Assisted Information Retrieval (Recherche d'Information et ses Applications) - RIAO 2007, 8th International Conference, Carnegie Mellon University, Pittsburgh, PA, USA, May 30 - June 1, 2007. Proceedings, CD-ROM
Robust test collections for retrieval evaluation
Ben Carterette
SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands, July 23-27, 2007
Semiautomatic evaluation of retrieval systems using document similarities
Ben Carterette
|
James Allan
Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, CIKM 2007, Lisbon, Portugal, November 6-10, 2007
Hypothesis testing with incomplete relevance judgments
Ben Carterette
|
Mark D. Smucker
Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, CIKM 2007, Lisbon, Portugal, November 6-10, 2007
A comparison of statistical significance tests for information retrieval evaluation
Mark D. Smucker
|
James Allan
|
Ben Carterette
Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, CIKM 2007, Lisbon, Portugal, November 6-10, 2007
2006
Learning a ranking from pairwise preferences
Ben Carterette
|
Desislava Petkova
SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6-11, 2006
Minimal test collections for retrieval evaluation
Ben Carterette
|
James Allan
|
Ramesh K. Sitaraman
SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6-11, 2006
2005
Comparing inverted files and signature files for searching a large lexicon
Ben Carterette
|
Fazli Can
2005 Volume 41 Issue 3
When will information retrieval be "good enough"?
James Allan
|
Ben Carterette
|
Joshua Lewis
SIGIR 2005: Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Salvador, Brazil, August 15-19, 2005
Incremental test collections
Ben Carterette
|
James Allan
Proceedings of the 2005 ACM CIKM International Conference on Information and Knowledge Management, Bremen, Germany, October 31 - November 5, 2005
Co-authors
- Evangelos Kanoulas 21
- Praveen Chandar 16
- James Allan 12
- Emine Yilmaz 10
- Paul D. Clough 8
- show all...
- Dongqing Zhu 7
- Ashraf Bah 7
- Mark Sanderson 6
- Virgiliu Pavlu 5
- Mustafa Zengin 5
- Rosie Jones 5
- Jussi Karlgren 5
- Mark M. Hall 5
- Fernando Diaz 4
- Paul N. Bennett 4
- Javed A. Aslam 4
- Rishabh Mehrotra 4
- Maria Eskevich 4
- Ian Soboroff 4
- Gareth J. F. Jones 4
- Sree Lekha Thota 3
- Mounia Lalmas 3
- Mark D. Smucker 3
- J. Shane Culpepper 3
- Hui Fang 3
- Sravana Reddy 3
- Ann Clifton 3
- Nick Craswell 3
- Michael D. Ekstrand 2
- Hongfang Liu 2
- Joana Correia 2
- William Webber 2
- Alistair Moffat 2
- Rodger Benham 2
- Zahra Nazari 2
- Christophe Charbuillet 2
- Aasish Pappu 2
- Yongze Yu 2
- Ashraf Bah Rabiou 2
- Aldo Lipani 2
- Peter Bailey 2
- Manisha Verma 2
- Ashwani Rao 2
- Aparna Kailasam 2
- Divya Muppaneni 2
- Donald Metzler 2
- Thorsten Joachims 2
- Hussein Suleman 2
- Jamie Callan 1
- Jaime Arguello 1
- David Maxwell Chickering 1
- Susan T. Dumais 1
- Kevin Roitero 1
- Asia Biega 1
- Ömer Kirnap 1
- Vijay Pappu 1
- Lucas Maystre 1
- Tiffany Wu 1
- Tony Jebara 1
- Roberto Sanchis-Ojeda 1
- Brian St. Thomas 1
- Stephen T. Wu 1
- James J. Masanz 1
- Asia J. Biega 1
- Bhaskar Mitra 1
- Ramesh K. Sitaraman 1
- Desislava Petkova 1
- Joshua Lewis 1
- Denis Charrier 1
- Johan Pages 1
- Martin Laurent 1
- Briana Vecchione 1
- Hugues Bouchard 1
- Markus Schedl 1
- Helia Hashemi 1
- Ching-Wei Chen 1
- Hamed Zamani 1
- Longqi Yang 1
- Oguz Semerci 1
- Gabriella Kazai 1
- Pablo Castells 1
- Julio Gonzalo 1
- Enrique Amigó 1
- Jian-Yun Nie 1
- Yi Zhang 1
- Krisztian Balog 1
- Jiafeng Guo 1
- Yi Fang 1
- Naveen Kumar 1
- Karankumar Sabhnani 1
- Blagovest Dachev 1
- Virgil Pavlu 1
- Carlos Castillo 1
- Evgeniy Gabrilovich 1
- Vanja Josifovski 1
- Damien Tardieu 1
- Samantha Hansen 1
- James McInerney 1
- Alois Gruson 1
- Dingcheng Li 1
- Kristin Maiden 1
- Deb Ehrenthal 1
- Fazli Can 1
- Diane Kelly 1
- Falk Scholer 1
- Filip Radlinski 1
- Douglas W. Oard 1
- Olivier Chapelle 1
- Fabrizio Sebastiani 1
- Tamer Elsayed 1
- Tanya Y. Berger-Wolf 1
- C. Maria Keet 1