2022

doi dblp
Learning Trustworthy Web Sources to Derive Correct Answers and Reduce Health Misinformation in Search
Dake Zhang | Amir Vakili Tahami | Mustafa Abualsaud | Mark D. Smucker
SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022

doi dblp
The Dark Side of Relevance: The Effect of Non-Relevant Results on Search Behavior
Mustafa Abualsaud | Mark D. Smucker
CHIIR '22: ACM SIGIR Conference on Human Information Interaction and Retrieval, Regensburg, Germany, March 14 - 18, 2022

2021

doi dblp
Assessing Top- Preferences
Charles L. A. Clarke | Alexandra Vtyurina | Mark D. Smucker
2021 Volume 39 Issue 3

doi dblp
Evaluation Measures Based on Preference Graphs
Charles L. A. Clarke | Chengxi Luo | Mark D. Smucker
SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021

doi dblp
Visualizing Searcher Gaze Patterns
Mustafa Abualsaud | Mark D. Smucker | Charles L. A. Clarke
CHIIR '21: ACM SIGIR Conference on Human Information Interaction and Retrieval, Canberra, ACT, Australia, March 14-19, 2021

2020

doi dblp
Evaluating sentence-level relevance feedback for high-recall information retrieval
Haotian Zhang | Gordon V. Cormack | Maura R. Grossman | Mark D. Smucker
2020 Volume 23 Issue 1

pdf dblp
Overview of the TREC 2020 Health Misinformation Track
Charles L. A. Clarke | Saira Rizvi | Mark D. Smucker | Maria Maistro | Guido Zuccon
Proceedings of the Twenty-Ninth Text REtrieval Conference, TREC 2020, Virtual Event [Gaithersburg, Maryland, USA], November 16-20, 2020

doi dblp
Offline Evaluation without Gain
Charles L. A. Clarke | Alexandra Vtyurina | Mark D. Smucker
ICTIR '20: The 2020 ACM SIGIR International Conference on the Theory of Information Retrieval, Virtual Event, Norway, September 14-17, 2020

doi dblp
Offline Evaluation by Maximum Similarity to an Ideal Ranking
Charles L. A. Clarke | Mark D. Smucker | Alexandra Vtyurina
CIKM '20: The 29th ACM International Conference on Information and Knowledge Management, Virtual Event, Ireland, October 19-23, 2020

doi dblp
A Think-Aloud Study to Understand Factors Affecting Online Health Search
Amira Ghenai | Mark D. Smucker | Charles L. A. Clarke
CHIIR '20: Conference on Human Information Interaction and Retrieval, Vancouver, BC, Canada, March 14-18, 2020

2019

pdf dblp
UWaterlooMDS at the TREC 2019 Decision Track
Mustafa Abualsaud | Fuat C. Beylunioglu | Mark D. Smucker | P. Robert Duimering
Proceedings of the Twenty-Eighth Text REtrieval Conference, TREC 2019, Gaithersburg, Maryland, USA, November 13-15, 2019

doi dblp
Dynamic Sampling Meets Pooling
Gordon V. Cormack | Haotian Zhang | Nimesh Ghelani | Mustafa Abualsaud | Mark D. Smucker | Maura R. Grossman | Shahin Rahbariasl | Amira Ghenai
Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, Paris, France, July 21-25, 2019

doi dblp
Time-Limits and Summaries for Faster Relevance Assessing
Shahin Rahbariasl | Mark D. Smucker
Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, Paris, France, July 21-25, 2019

doi dblp
Patterns of Search Result Examination: Query to First Action
Mustafa Abualsaud | Mark D. Smucker
Proceedings of the 28th ACM International Conference on Information and Knowledge Management, CIKM 2019, Beijing, China, November 3-7, 2019

2018

doi dblp
Research Frontiers in Information Retrieval: Report from the Third Strategic Workshop on Information Retrieval in Lorne (SWIRL 2018)
J. Shane Culpepper | Fernando Diaz | Mark D. Smucker
2018 Volume 52 Issue 1

pdf dblp
Refresh Strategies in Continuous Active Learning
Nimesh Ghelani | Gordon V. Cormack | Mark D. Smucker
Joint Proceedings of the First International Workshop on Professional Search (ProfS2018); the Second Workshop on Knowledge Graphs and Semantics for Text Retrieval, Analysis, and Understanding (KG4IR); and the International Workshop on Data Search (DATA:SEARCH'18) Co-located with (ACM SIGIR 2018), Ann Arbor, Michigan, USA, July 12, 2018

pdf dblp
UWaterlooMDS at the TREC 2018 Common Core Track
Mustafa Abualsaud | Gordon V. Cormack | Nimesh Ghelani | Amira Ghenai | Maura R. Grossman | Shahin Rahbariasl | Haotian Zhang | Mark D. Smucker
Proceedings of the Twenty-Seventh Text REtrieval Conference, TREC 2018, Gaithersburg, Maryland, USA, November 14-16, 2018

doi dblp
A System for Efficient High-Recall Retrieval
Mustafa Abualsaud | Nimesh Ghelani | Haotian Zhang | Mark D. Smucker | Gordon V. Cormack | Maura R. Grossman
The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA, July 08-12, 2018

doi dblp
Effective User Interaction for High-Recall Retrieval: Less is More
Haotian Zhang | Mustafa Abualsaud | Nimesh Ghelani | Mark D. Smucker | Gordon V. Cormack | Maura R. Grossman
Proceedings of the 27th ACM International Conference on Information and Knowledge Management, CIKM 2018, Torino, Italy, October 22-26, 2018

doi dblp
A Study of Immediate Requery Behavior in Search
Haotian Zhang | Mustafa Abualsaud | Mark D. Smucker
Proceedings of the 2018 Conference on Human Information Interaction and Retrieval, CHIIR 2018, New Brunswick, NJ, USA, March 11-15, 2018

2017

doi dblp
Overview of Special Issue
James Allan | Nicholas J. Belkin | Paul N. Bennett | Jamie Callan | Charles L. A. Clarke | Fernando Diaz | Susan T. Dumais | Nicola Ferro | Donna Harman | Djoerd Hiemstra | Ian Ruthven | Tetsuya Sakai | Mark D. Smucker | Justin Zobel
2017 Volume 51 Issue 2

pdf dblp
UWaterlooMDS at the TREC 2017 Common Core Track
Haotian Zhang | Mustafa Abualsaud | Nimesh Ghelani | Angshuman Ghosh | Mark D. Smucker | Gordon V. Cormack | Maura R. Grossman
Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017

doi dblp
The Positive and Negative Influence of Search Results on People's Decisions about the Efficacy of Medical Treatments
Frances A. Pogacar | Amira Ghenai | Mark D. Smucker | Charles L. A. Clarke
Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2017, Amsterdam, The Netherlands, October 1-4, 2017

doi dblp
Automatically Extracting High-Quality Negative Examples for Answer Selection in Question Answering
Haotian Zhang | Jinfeng Rao | Jimmy Lin | Mark D. Smucker
Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7-11, 2017

2016

doi dblp
Sampling Strategies and Active Learning for Volume Estimation
Haotian Zhang | Jimmy Lin | Gordon V. Cormack | Mark D. Smucker
Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy, July 17-21, 2016

doi dblp
Optimizing Nugget Annotations with Active Learning
Gaurav Baruah | Haotian Zhang | Rakesh Guttikonda | Jimmy Lin | Mark D. Smucker | Olga Vechtomova
Proceedings of the 25th ACM International Conference on Information and Knowledge Management, CIKM 2016, Indianapolis, IN, USA, October 24-28, 2016

doi dblp
Modeling Optimal Switching Behavior
Mark D. Smucker | Charles L. A. Clarke
Proceedings of the 2016 ACM Conference on Human Information Interaction and Retrieval, CHIIR 2016, Carrboro, North Carolina, USA, March 13-17, 2016

doi dblp
Are Secondary Assessors Uncertain When They Disagree About Relevance Judgements?
Aiman Lafi Al-Harbi | Mark D. Smucker
Proceedings of the 2016 ACM Conference on Human Information Interaction and Retrieval, CHIIR 2016, Carrboro, North Carolina, USA, March 13-17, 2016

2015

pdf dblp
WaterlooClarke: TREC 2015 Total Recall Track
Haotian Zhang | Wu Lin | Yipeng Wang | Charles L. A. Clarke | Mark D. Smucker
Proceedings of The Twenty-Fourth Text REtrieval Conference, TREC 2015, Gaithersburg, Maryland, USA, November 17-20, 2015

doi dblp
Pooling for User-Oriented Evaluation Measures
Gaurav Baruah | Adam Roegiest | Mark D. Smucker
Proceedings of the 2015 International Conference on The Theory of Information Retrieval, ICTIR 2015, Northampton, Massachusetts, USA, September 27-30, 2015

doi dblp
IR Evaluation: Modeling User Behavior for Measuring Effectiveness
Charles L. A. Clarke | Mark D. Smucker | Emine Yilmaz
Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile, August 9-13, 2015

doi dblp
Evaluating Streams of Evolving News Events
Gaurav Baruah | Mark D. Smucker | Charles L. A. Clarke
Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile, August 9-13, 2015

2014

doi dblp
Report on the CIKM workshop on living labs for information retrieval evaluation
Krisztian Balog | David Elsweiler | Evangelos Kanoulas | Liadh Kelly | Mark D. Smucker
2014 Volume 48 Issue 1

doi dblp
The effect of expanding relevance judgements with duplicates
Gaurav Baruah | Adam Roegiest | Mark D. Smucker
The 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '14, Gold Coast , QLD, Australia - July 06 - 11, 2014

doi dblp
Mouse movement during relevance judging: implications for determining user attention
Mark D. Smucker | Xiaoyu Sunny Guo | Andrew Toulis
The 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '14, Gold Coast , QLD, Australia - July 06 - 11, 2014

doi dblp
Time well spent
Charles L. A. Clarke | Mark D. Smucker
Fifth Information Interaction in Context Symposium, IIiX '14, Regensburg, Germany, August 26-29, 2014

doi dblp
A qualitative exploration of secondary assessor relevance judging behavior
Aiman Lafi Al-Harbi | Mark D. Smucker
Fifth Information Interaction in Context Symposium, IIiX '14, Regensburg, Germany, August 26-29, 2014

doi dblp
Tolerance of Effectiveness Measures to Relevance Judging Errors
Le Li | Mark D. Smucker
Advances in Information Retrieval - 36th European Conference on IR Research, ECIR 2014, Amsterdam, The Netherlands, April 13-16, 2014. Proceedings

2013

doi dblp
Report on the SIGIR 2013 workshop on modeling user behavior for information retrieval evaluation (MUBE 2013)
Charles L. A. Clarke | Luanne Freund | Mark D. Smucker | Emine Yilmaz
2013 Volume 47 Issue 2

doi dblp
HCIR 2013: the seventh international symposium on human-computer interaction and information retrieval
Robert Capra | Luanne Freund | Catherine L. Smith | Mark D. Smucker | Ryen W. White
2013 Volume 47 Issue 2

doi dblp
Proceedings of the 2013 workshop on Living labs for information retrieval evaluation, LivingLab@CIKM 2013, San Francisco, California, USA, November 1, 2013

Proceedings of the 2013 workshop on Living labs for information retrieval evaluation, LivingLab@CIKM 2013, San Francisco, California, USA, November 1, 2013

pdf dblp
Overview of the TREC 2013 Crowdsourcing Track
Mark D. Smucker | Gabriella Kazai | Matthew Lease
Proceedings of The Twenty-Second Text REtrieval Conference, TREC 2013, Gaithersburg, Maryland, USA, November 19-22, 2013

doi dblp
SIGIR 2013 workshop on modeling user behavior for information retrieval evaluation
Charles L. A. Clarke | Luanne Freund | Mark D. Smucker | Emine Yilmaz
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
CIKM 2013 workshop on living labs for information retrieval evaluation
Krisztian Balog | David Elsweiler | Evangelos Kanoulas | Liadh Kelly | Mark D. Smucker
22nd ACM International Conference on Information and Knowledge Management, CIKM'13, San Francisco, CA, USA, October 27 - November 1, 2013

2012

pdf dblp
Overview of the TREC 2012 Crowdsourcing Track
Mark D. Smucker | Gabriella Kazai | Matthew Lease
Proceedings of The Twenty-First Text REtrieval Conference, TREC 2012, Gaithersburg, Maryland, USA, November 6-9, 2012

doi dblp
Time to judge relevance as an indicator of assessor error
Mark D. Smucker | Chandra Prakash Jethani
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012

doi dblp
Time-based calibration of effectiveness measures
Mark D. Smucker | Charles L. A. Clarke
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012

doi dblp
Stochastic simulation of time-biased gain
Mark D. Smucker | Charles L. A. Clarke
21st ACM International Conference on Information and Knowledge Management, CIKM'12, Maui, HI, USA, October 29 - November 02, 2012

doi dblp
Human question answering performance using an interactive document retrieval system
Mark D. Smucker | James Allan | Blagovest Dachev
Information Interaction in Context: 2012, IIix'12, Nijmegen, The Netherlands, August 21-24, 2012

2011

doi dblp
Efficient and effective spam filtering and re-ranking for large web datasets
Gordon V. Cormack | Mark D. Smucker | Charles L. A. Clarke
2011 Volume 14 Issue 5

pdf dblp
Crowdsourcing with a Crowd of One and Other TREC 2011 Crowdsourcing and Web Track Experiments
Mark D. Smucker
Proceedings of The Twentieth Text REtrieval Conference, TREC 2011, Gaithersburg, Maryland, USA, November 15-18, 2011

doi dblp
Measuring assessor accuracy: a comparison of nist assessors and user study participants
Mark D. Smucker | Chandra Prakash Jethani
Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, July 25-29, 2011

2010

doi dblp
Report on the SIGIR 2010 workshop on the simulation of interaction
Leif Azzopardi | Kalervo Järvelin | Jaap Kamps | Mark D. Smucker
2010 Volume 44 Issue 2

pdf dblp
University of Waterloo at TREC 2010: Legal Interactive
Mark D. Smucker | Charles L. A. Clarke | Gordon V. Cormack | Olga Vechtomova
Proceedings of The Nineteenth Text REtrieval Conference, TREC 2010, Gaithersburg, Maryland, USA, November 16-19, 2010

doi dblp
Human performance and retrieval precision revisited
Mark D. Smucker | Chandra Prakash Jethani
Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2010, Geneva, Switzerland, July 19-23, 2010

2009

pdf dblp
Experiments with ClueWeb09: Relevance Feedback and Web Tracks
Mark D. Smucker | Charles L. A. Clarke | Gordon V. Cormack
Proceedings of The Eighteenth Text REtrieval Conference, TREC 2009, Gaithersburg, Maryland, USA, November 17-20, 2009

doi dblp
A New Measure of the Cluster Hypothesis
Mark D. Smucker | James Allan
Advances in Information Retrieval Theory, Second International Conference on the Theory of Information Retrieval, ICTIR 2009, Cambridge, UK, September 10-12, 2009, Proceedings

doi dblp
Agreement among statistical significance tests for information retrieval evaluation at varying sample sizes
Mark D. Smucker | James Allan | Ben Carterette
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, July 19-23, 2009

2008

doi dblp
How do users find things with PubMed?: towards automatic utility evaluation with user simulations
Jimmy Lin | Mark D. Smucker
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, Singapore, July 20-24, 2008

2007

pdf dblp
UMass Complex Interactive Question Answering (ciQA) 2007: Human Performance as Question Answerers
Mark D. Smucker | James Allan | Blagovest Dachev
Proceedings of The Sixteenth Text REtrieval Conference, TREC 2007, Gaithersburg, Maryland, USA, November 5-9, 2007

doi dblp
Using similarity links as shortcuts to relevant web pages
Mark D. Smucker | James Allan
SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands, July 23-27, 2007

doi dblp
Hypothesis testing with incomplete relevance judgments
Ben Carterette | Mark D. Smucker
Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, CIKM 2007, Lisbon, Portugal, November 6-10, 2007

doi dblp
A comparison of statistical significance tests for information retrieval evaluation
Mark D. Smucker | James Allan | Ben Carterette
Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, CIKM 2007, Lisbon, Portugal, November 6-10, 2007

2006

pdf dblp
UMass Genomics 2006: Query-Biased Pseudo Relevance Feedback
Mark D. Smucker
Proceedings of the Fifteenth Text REtrieval Conference, TREC 2006, Gaithersburg, Maryland, USA, November 14-17, 2006

doi dblp
Lightening the load of document smoothing for better language modeling retrieval
Mark D. Smucker | James Allan
SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6-11, 2006

doi dblp
Find-similar: similarity browsing as a search tool
Mark D. Smucker | James Allan
SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6-11, 2006

2004

pdf dblp
UMass at TREC 2004: Novelty and HARD
Nasreen Abdul Jaleel | James Allan | W. Bruce Croft | Fernando Diaz | Leah S. Larkey | Xiaoyan Li | Mark D. Smucker | Courtney Wade
Proceedings of the Thirteenth Text REtrieval Conference, TREC 2004, Gaithersburg, Maryland, USA, November 16-19, 2004

Search