Mark D. Smucker

2025

doi dblp
Extending MovieLens-32M to Provide New Evaluation Objectives.
Mark D. Smucker|Houmaan Chamani
Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025

2024

dblp
Overview of the TREC 2024 Lateral Reading Track.
Dake Zhang|Mark D. Smucker|Charles L. A. Clarke
Proceedings of the Thirty-Third Text REtrieval Conference, TREC 2024, Gaithersburg, MD, USA, November 18-22, 2024

2023

doi dblp
A Preference Judgment Tool for Authoritative Assessment.
Mahsa Seifikar|Linh Nhi Phan Minh|Negar Arabzadeh|Charles L. A. Clarke|Mark D. Smucker
Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2023, Taipei, Taiwan, July 23-27, 2023

2022

doi dblp
The Dark Side of Relevance: The Effect of Non-Relevant Results on Search Behavior.
Mustafa Abualsaud|Mark D. Smucker
CHIIR '22: ACM SIGIR Conference on Human Information Interaction and Retrieval, Regensburg, Germany, March 14 - 18, 2022
doi dblp
Learning Trustworthy Web Sources to Derive Correct Answers and Reduce Health Misinformation in Search.
Dake Zhang|Amir Vakili Tahami|Mustafa Abualsaud|Mark D. Smucker
SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022
dblp
UWaterlooMDS at the TREC 2022 Health Misinformation Track.
Amir Vakili Tahami|Dake Zhang|Mark D. Smucker
Proceedings of the Thirty-First Text REtrieval Conference, TREC 2022, online, November 15-19, 2022

2021

doi dblp
Assessing Top- Preferences.
Charles L. A. Clarke|Alexandra Vtyurina|Mark D. Smucker
ACM Transactions on Information Systems (TOIS) 2021 Volume 39 Issue 3
doi dblp
Visualizing Searcher Gaze Patterns.
Mustafa Abualsaud|Mark D. Smucker|Charles L. A. Clarke
CHIIR '21: ACM SIGIR Conference on Human Information Interaction and Retrieval, Canberra, ACT, Australia, March 14-19, 2021
doi dblp
Evaluation Measures Based on Preference Graphs.
Charles L. A. Clarke|Chengxi Luo|Mark D. Smucker
SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021
dblp
UWaterlooMDS at the TREC 2021 Health Misinformation Track.
Mustafa Abualsaud|Kamyar Ghajar|Linh Nhi Phan Minh|Dake Zhang|Irene Xiangyi Chen|Mark D. Smucker|Amir Vakili Tahami
Proceedings of the Thirtieth Text REtrieval Conference, TREC 2021, online, November 15-19, 2021
dblp
Overview of the TREC 2021 Health Misinformation Track.
Charles L. A. Clarke|Maria Maistro|Mark D. Smucker
Proceedings of the Thirtieth Text REtrieval Conference, TREC 2021, online, November 15-19, 2021

2020

doi dblp
Evaluating sentence-level relevance feedback for high-recall information retrieval.
Haotian Zhang|Gordon V. Cormack|Maura R. Grossman|Mark D. Smucker
Discover Computing 2020 Volume 23 Issue 1
doi dblp
A Think-Aloud Study to Understand Factors Affecting Online Health Search.
Amira Ghenai|Mark D. Smucker|Charles L. A. Clarke
CHIIR '20: Conference on Human Information Interaction and Retrieval, Vancouver, BC, Canada, March 14-18, 2020.
doi dblp
Offline Evaluation by Maximum Similarity to an Ideal Ranking.
Charles L. A. Clarke|Mark D. Smucker|Alexandra Vtyurina
CIKM '20: The 29th ACM International Conference on Information and Knowledge Management, Virtual Event, Ireland, October 19-23, 2020
doi dblp
Offline Evaluation without Gain.
Charles L. A. Clarke|Alexandra Vtyurina|Mark D. Smucker
ICTIR '20: The 2020 ACM SIGIR International Conference on the Theory of Information Retrieval, Virtual Event, Norway, September 14-17, 2020
dblp
Overview of the TREC 2020 Health Misinformation Track.
Charles L. A. Clarke|Saira Rizvi|Mark D. Smucker|Maria Maistro|Guido Zuccon
Proceedings of the Twenty-Ninth Text REtrieval Conference, TREC 2020, Virtual Event [Gaithersburg, Maryland, USA], November 16-20, 2020.

2019

doi dblp
Patterns of Search Result Examination: Query to First Action.
Mustafa Abualsaud|Mark D. Smucker
Proceedings of the 28th ACM International Conference on Information and Knowledge Management, CIKM 2019, Beijing, China, November 3-7, 2019.
doi dblp
Dynamic Sampling Meets Pooling.
Gordon V. Cormack|Haotian Zhang|Nimesh Ghelani|Mustafa Abualsaud|Mark D. Smucker|Maura R. Grossman|Shahin Rahbariasl|Amira Ghenai
Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, Paris, France, July 21-25, 2019.
doi dblp
Time-Limits and Summaries for Faster Relevance Assessing.
Shahin Rahbariasl|Mark D. Smucker
Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, Paris, France, July 21-25, 2019.
dblp
UWaterlooMDS at the TREC 2019 Decision Track.
Mustafa Abualsaud|Fuat Can Beylunioglu|Mark D. Smucker|P. Robert Duimering
Proceedings of the Twenty-Eighth Text REtrieval Conference, TREC 2019, Gaithersburg, Maryland, USA, November 13-15, 2019.

2018

doi dblp
Research Frontiers in Information Retrieval: Report from the Third Strategic Workshop on Information Retrieval in Lorne (SWIRL 2018).
J. Shane Culpepper|Fernando Diaz|Mark D. Smucker
SIGIR Forum 2018 Volume 52 Issue 1
doi dblp
A Study of Immediate Requery Behavior in Search.
Haotian Zhang|Mustafa Abualsaud|Mark D. Smucker
Proceedings of the 2018 Conference on Human Information Interaction and Retrieval, CHIIR 2018, New Brunswick, NJ, USA, March 11-15, 2018
doi dblp
Effective User Interaction for High-Recall Retrieval: Less is More.
Haotian Zhang|Mustafa Abualsaud|Nimesh Ghelani|Mark D. Smucker|Gordon V. Cormack|Maura R. Grossman
Proceedings of the 27th ACM International Conference on Information and Knowledge Management, CIKM 2018, Torino, Italy, October 22-26, 2018
doi dblp
A System for Efficient High-Recall Retrieval.
Mustafa Abualsaud|Nimesh Ghelani|Haotian Zhang|Mark D. Smucker|Gordon V. Cormack|Maura R. Grossman
The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA, July 08-12, 2018
dblp
UWaterlooMDS at the TREC 2018 Common Core Track.
Mustafa Abualsaud|Gordon V. Cormack|Nimesh Ghelani|Amira Ghenai|Maura R. Grossman|Shahin Rahbariasl|Haotian Zhang|Mark D. Smucker
Proceedings of the Twenty-Seventh Text REtrieval Conference, TREC 2018, Gaithersburg, Maryland, USA, November 14-16, 2018

2017

doi dblp
Overview of Special Issue.
James Allan|Nicholas J. Belkin|Paul N. Bennett|Jamie Callan|Charles L. A. Clarke|Fernando Diaz|Susan T. Dumais|Nicola Ferro|Donna Harman|Djoerd Hiemstra|Ian Ruthven|Tetsuya Sakai|Mark D. Smucker|Justin Zobel
SIGIR Forum 2017 Volume 51 Issue 2
doi dblp
The Positive and Negative Influence of Search Results on People's Decisions about the Efficacy of Medical Treatments.
Frances A. Pogacar|Amira Ghenai|Mark D. Smucker|Charles L. A. Clarke
Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2017, Amsterdam, The Netherlands, October 1-4, 2017
doi dblp
Automatically Extracting High-Quality Negative Examples for Answer Selection in Question Answering.
Haotian Zhang|Jinfeng Rao|Jimmy Lin|Mark D. Smucker
Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7-11, 2017
dblp
UWaterlooMDS at the TREC 2017 Common Core Track.
Haotian Zhang|Mustafa Abualsaud|Nimesh Ghelani|Angshuman Ghosh|Mark D. Smucker|Gordon V. Cormack|Maura R. Grossman
Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017

2016

doi dblp
Are Secondary Assessors Uncertain When They Disagree About Relevance Judgements?
Aiman Lafi Al-Harbi|Mark D. Smucker
Proceedings of the 2016 ACM Conference on Human Information Interaction and Retrieval, CHIIR 2016, Carrboro, North Carolina, USA, March 13-17, 2016
doi dblp
Modeling Optimal Switching Behavior.
Mark D. Smucker|Charles L. A. Clarke
Proceedings of the 2016 ACM Conference on Human Information Interaction and Retrieval, CHIIR 2016, Carrboro, North Carolina, USA, March 13-17, 2016
doi dblp
Optimizing Nugget Annotations with Active Learning.
Gaurav Baruah|Haotian Zhang|Rakesh Guttikonda|Jimmy Lin|Mark D. Smucker|Olga Vechtomova
Proceedings of the 25th ACM International Conference on Information and Knowledge Management, CIKM 2016, Indianapolis, IN, USA, October 24-28, 2016
doi dblp
Sampling Strategies and Active Learning for Volume Estimation.
Haotian Zhang|Jimmy Lin|Gordon V. Cormack|Mark D. Smucker
Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy, July 17-21, 2016

2015

doi dblp
Pooling for User-Oriented Evaluation Measures.
Gaurav Baruah|Adam Roegiest|Mark D. Smucker
Proceedings of the 2015 International Conference on The Theory of Information Retrieval, ICTIR 2015, Northampton, Massachusetts, USA, September 27-30, 2015
doi dblp
Evaluating Streams of Evolving News Events.
Gaurav Baruah|Mark D. Smucker|Charles L. A. Clarke
Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile, August 9-13, 2015
doi dblp
IR Evaluation: Modeling User Behavior for Measuring Effectiveness.
Charles L. A. Clarke|Mark D. Smucker|Emine Yilmaz
Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile, August 9-13, 2015
dblp
WaterlooClarke: TREC 2015 Total Recall Track.
Haotian Zhang|Wu Lin|Yipeng Wang|Charles L. A. Clarke|Mark D. Smucker
Proceedings of The Twenty-Fourth Text REtrieval Conference, TREC 2015, Gaithersburg, Maryland, USA, November 17-20, 2015

2014

doi dblp
Report on the CIKM workshop on living labs for information retrieval evaluation.
Krisztian Balog|David Elsweiler|Evangelos Kanoulas|Liadh Kelly|Mark D. Smucker
SIGIR Forum 2014 Volume 48 Issue 1
doi dblp
Tolerance of Effectiveness Measures to Relevance Judging Errors.
Le Li|Mark D. Smucker
Advances in Information Retrieval - 36th European Conference on IR Research, ECIR 2014, Amsterdam, The Netherlands, April 13-16, 2014. Proceedings
doi dblp
A qualitative exploration of secondary assessor relevance judging behavior.
Aiman Lafi Al-Harbi|Mark D. Smucker
Fifth Information Interaction in Context Symposium, IIiX '14, Regensburg, Germany, August 26-29, 2014
doi dblp
Time well spent.
Charles L. A. Clarke|Mark D. Smucker
Fifth Information Interaction in Context Symposium, IIiX '14, Regensburg, Germany, August 26-29, 2014
doi dblp
The effect of expanding relevance judgements with duplicates.
Gaurav Baruah|Adam Roegiest|Mark D. Smucker
The 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '14, Gold Coast , QLD, Australia - July 06 - 11, 2014
doi dblp
Mouse movement during relevance judging: implications for determining user attention.
Mark D. Smucker|Xiaoyu Sunny Guo|Anthony Ventresque|Andrew Toulis|Anthony Ventresque|Xiaoyu Sunny Guo
The 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '14, Gold Coast , QLD, Australia - July 06 - 11, 2014

2013

doi dblp
Proceedings of the 2013 workshop on Living labs for information retrieval evaluation, LivingLab@CIKM 2013, San Francisco, California, USA, November 1, 2013
Krisztian Balog|Rajiv Mehrotra|Rajiv Mehrotra|Rajendra S. Yavatkar|David Elsweiler|Krisztian Balog|David Elsweiler|Rajendra S. Yavatkar
Workshop on Living Labs for Information Retrieval Evaluation 2013
doi dblp
HCIR 2013: the seventh international symposium on human-computer interaction and information retrieval.
Robert Capra|Luanne Freund|Catherine L. Smith|Mark D. Smucker|Ryen W. White
SIGIR Forum 2013 Volume 47 Issue 2
doi dblp
Report on the SIGIR 2013 workshop on modeling user behavior for information retrieval evaluation (MUBE 2013).
Charles L. A. Clarke|Luanne Freund|Mark D. Smucker|Emine Yilmaz
SIGIR Forum 2013 Volume 47 Issue 2
doi dblp
CIKM 2013 workshop on living labs for information retrieval evaluation.
Krisztian Balog|David Elsweiler|Evangelos Kanoulas|Liadh Kelly|Mark D. Smucker
22nd ACM International Conference on Information and Knowledge Management, CIKM'13, San Francisco, CA, USA, October 27 - November 1, 2013
doi dblp
SIGIR 2013 workshop on modeling user behavior for information retrieval evaluation.
Charles L. A. Clarke|Luanne Freund|Mark D. Smucker|Emine Yilmaz
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013
dblp
Overview of the TREC 2013 Crowdsourcing Track.
Mark D. Smucker|Gabriella Kazai|Matthew Lease
Proceedings of The Twenty-Second Text REtrieval Conference, TREC 2013, Gaithersburg, Maryland, USA, November 19-22, 2013

2012

doi dblp
Stochastic simulation of time-biased gain.
Mark D. Smucker|Charles L. A. Clarke
21st ACM International Conference on Information and Knowledge Management, CIKM'12, Maui, HI, USA, October 29 - November 02, 2012
doi dblp
Modeling user variance in time-biased gain.
Mark D. Smucker|Charles L. A. Clarke
Human-Computer Information Retrieval Symposium, HCIR 2012, Cambridge, MA, USA, October 4-5, 2012
doi dblp
Human question answering performance using an interactive document retrieval system.
Mark D. Smucker|James Allan|Blagovest Dachev
Information Interaction in Context: 2012, IIix'12, Nijmegen, The Netherlands, August 21-24, 2012
doi dblp
Time-based calibration of effectiveness measures.
Mark D. Smucker|Charles L. A. Clarke
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012
doi dblp
Time to judge relevance as an indicator of assessor error.
Mark D. Smucker|Chandra Prakash Jethani
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012
dblp
Overview of the TREC 2012 Crowdsourcing Track.
Mark D. Smucker|Gabriella Kazai|Matthew Lease
Proceedings of The Twenty-First Text REtrieval Conference, TREC 2012, Gaithersburg, Maryland, USA, November 6-9, 2012

2011

doi dblp
Efficient and effective spam filtering and re-ranking for large web datasets.
Gordon V. Cormack|Mark D. Smucker|Charles L. A. Clarke
Discover Computing 2011 Volume 14 Issue 5
doi dblp
Measuring assessor accuracy: a comparison of nist assessors and user study participants.
Mark D. Smucker|Chandra Prakash Jethani
Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, July 25-29, 2011
dblp
Crowdsourcing with a Crowd of One and Other TREC 2011 Crowdsourcing and Web Track Experiments.
Mark D. Smucker
Proceedings of The Twentieth Text REtrieval Conference, TREC 2011, Gaithersburg, Maryland, USA, November 15-18, 2011

2010

doi dblp
Report on the SIGIR 2010 workshop on the simulation of interaction.
Leif Azzopardi|Kalervo Järvelin|Jaap Kamps|Mark D. Smucker
SIGIR Forum 2010 Volume 44 Issue 2
doi dblp
Human performance and retrieval precision revisited.
Mark D. Smucker|Chandra Prakash Jethani
Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2010, Geneva, Switzerland, July 19-23, 2010
dblp
University of Waterloo at TREC 2010: Legal Interactive.
Mark D. Smucker|Charles L. A. Clarke|Gordon V. Cormack|Olga Vechtomova
Proceedings of The Nineteenth Text REtrieval Conference, TREC 2010, Gaithersburg, Maryland, USA, November 16-19, 2010

2009

doi dblp
A New Measure of the Cluster Hypothesis.
Mark D. Smucker|James Allan
Advances in Information Retrieval Theory, Second International Conference on the Theory of Information Retrieval, ICTIR 2009, Cambridge, UK, September 10-12, 2009, Proceedings
doi dblp
Agreement among statistical significance tests for information retrieval evaluation at varying sample sizes.
Mark D. Smucker|James Allan|Ben Carterette
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, July 19-23, 2009
dblp
Experiments with ClueWeb09: Relevance Feedback and Web Tracks.
Mark D. Smucker|Charles L. A. Clarke|Gordon V. Cormack
Proceedings of The Eighteenth Text REtrieval Conference, TREC 2009, Gaithersburg, Maryland, USA, November 17-20, 2009

2008

doi dblp
How do users find things with PubMed?: towards automatic utility evaluation with user simulations.
Jimmy Lin|Mark D. Smucker
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, Singapore, July 20-24, 2008

2007

doi dblp
Hypothesis testing with incomplete relevance judgments.
Ben Carterette|Mark D. Smucker
Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, CIKM 2007, Lisbon, Portugal, November 6-10, 2007
doi dblp
A comparison of statistical significance tests for information retrieval evaluation.
Mark D. Smucker|James Allan|Ben Carterette
Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, CIKM 2007, Lisbon, Portugal, November 6-10, 2007
doi dblp
Using similarity links as shortcuts to relevant web pages.
Mark D. Smucker|James Allan
SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands, July 23-27, 2007
dblp
UMass Complex Interactive Question Answering (ciQA) 2007: Human Performance as Question Answerers.
Mark D. Smucker|James Allan|Blagovest Dachev
Proceedings of The Sixteenth Text REtrieval Conference, TREC 2007, Gaithersburg, Maryland, USA, November 5-9, 2007

2006

doi dblp
Find-similar: similarity browsing as a search tool.
Mark D. Smucker|James Allan
SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6-11, 2006
doi dblp
Lightening the load of document smoothing for better language modeling retrieval.
Mark D. Smucker|James Allan
SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6-11, 2006
dblp
UMass Genomics 2006: Query-Biased Pseudo Relevance Feedback.
Mark D. Smucker
Proceedings of the Fifteenth Text REtrieval Conference, TREC 2006, Gaithersburg, Maryland, USA, November 14-17, 2006

2004

dblp
UMass at TREC 2004: Novelty and HARD.
Nasreen Abdul Jaleel|James Allan|W. Bruce Croft|Fernando Diaz|Leah S. Larkey|Xiaoyan Li|Mark D. Smucker|Courtney Wade
Proceedings of the Thirteenth Text REtrieval Conference, TREC 2004, Gaithersburg, Maryland, USA, November 16-19, 2004