2023

doi dblp
New Metrics to Encourage Innovation and Diversity in Information Retrieval Approaches
Mehmet Deniz Türkmen | Matthew Lease | Mücahid Kutlu
Advances in Information Retrieval - 45th European Conference on Information Retrieval, ECIR 2023, Dublin, Ireland, April 2-6, 2023, Proceedings, Part II

2022

doi dblp
Measuring Annotator Agreement Generally across Complex Structured, Multi-object, and Free-text Annotation Tasks
Alexander Braylan | Omar Alonso | Matthew Lease
WWW '22: The ACM Web Conference 2022, Virtual Event, Lyon, France, April 25 - 29, 2022

2021

doi dblp
Pareto Solutions vs Dataset Optima: Concepts and Methods for Optimizing Competing Objectives with Constraints in Retrieval
Soumyajit Gupta | Gurpreet Singh | Anubrata Das | Matthew Lease
ICTIR '21: The 2021 ACM SIGIR International Conference on the Theory of Information Retrieval, Virtual Event, Canada, July 11, 2021

2020

doi dblp
Efficient Test Collection Construction via Active Learning
Md. Mustafizur Rahman | Mücahid Kutlu | Tamer Elsayed | Matthew Lease
ICTIR '20: The 2020 ACM SIGIR International Conference on the Theory of Information Retrieval, Virtual Event, Norway, September 14-17, 2020

doi dblp
Modeling and Aggregation of Complex Annotations via Annotation Distances
Alexander Braylan | Matthew Lease
WWW '20: The Web Conference 2020, Taipei, Taiwan, April 20-24, 2020

2019

doi dblp
FACTS-IR: fairness, accountability, confidentiality, transparency, and safety in information retrieval
Alexandra Olteanu | Jean Garcia-Gathright | Maarten de Rijke | Michael D. Ekstrand | Adam Roegiest | Aldo Lipani | Alex Beutel | Ana Lucic | Ana-Andreea Stoica | Anubrata Das | Asia Biega | Bart Voorn | Claudia Hauff | Damiano Spina | David D. Lewis | Douglas W. Oard | Emine Yilmaz | Faegheh Hasibi | Gabriella Kazai | Graham McDonald | Hinda Haned | Iadh Ounis | Ilse van der Linden | Joris Baan | Kamuela N. Lau | Krisztian Balog | Mahmoud F. Sayed | Maria Panteli | Mark Sanderson | Matthew Lease | Preethi Lahoti | Toshihiro Kamishima
2019 Volume 53 Issue 2

doi dblp
Constructing Test Collections using Multi-armed Bandits and Active Learning
Md. Mustafizur Rahman | Mücahid Kutlu | Matthew Lease
The World Wide Web Conference, WWW 2019, San Francisco, CA, USA, May 13-17, 2019

doi dblp
Correlation, Prediction and Ranking of Evaluation Metrics in Information Retrieval
Soumyajit Gupta | Mücahid Kutlu | Vivek Khetan | Matthew Lease
Advances in Information Retrieval - 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14-18, 2019, Proceedings, Part I

2018

doi dblp
Neural information retrieval: at the end of the early years
Kezban Dilek Onal | Ye Zhang | Ismail Sengor Altingovde | Md. Mustafizur Rahman | Pinar Karagoz | Alex Braylan | Brandon Dang | Heng-Lu Chang | Henna Kim | Quinten McNamara | Aaron Angert | Edward Banner | Vivek Khetan | Tyler McDonnell | An Thanh Nguyen | Dan Xu | Byron C. Wallace | Maarten de Rijke | Matthew Lease
2018 Volume 21 Issue 2-3

doi dblp
Intelligent topic selection for low-cost information retrieval evaluation: A New perspective on deep vs. shallow judging
Mücahid Kutlu | Tamer Elsayed | Matthew Lease
2018 Volume 54 Issue 1

doi dblp
Crowd vs. Expert: What Can Relevance Judgment Rationales Teach Us About Assessor Disagreement?
Mücahid Kutlu | Tyler McDonnell | Yassmine Barkallah | Tamer Elsayed | Matthew Lease
The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA, July 08-12, 2018

doi dblp
When Rank Order Isn't Enough: New Statistical-Significance-Aware Correlation Measures
Mücahid Kutlu | Tamer Elsayed | Maram Hasanain | Matthew Lease
Proceedings of the 27th ACM International Conference on Information and Knowledge Management, CIKM 2018, Torino, Italy, October 22-26, 2018

pdf dblp
Fact Checking and Information Retrieval
Matthew Lease
Proceedings of the First Biennial Conference on Design of Experimental Search & Information Retrieval Systems, Bertinoro, Italy, August 28-31, 2018

pdf dblp
Mix and Match: Collaborative Expert-Crowd Judging for Building Test Collections Accurately and Affordably
Mücahid Kutlu | Tyler McDonnell | Aashish Sheshadri | Tamer Elsayed | Matthew Lease
Proceedings of the First Biennial Conference on Design of Experimental Search & Information Retrieval Systems, Bertinoro, Italy, August 28-31, 2018

2016

doi dblp
ArabicWeb16: A New Crawl for Today's Arabic Web
Reem Suwaileh | Mücahid Kutlu | Nihal Fathima | Tamer Elsayed | Matthew Lease
Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy, July 17-21, 2016

2015

doi dblp
A Discriminative Approach to Predicting Assessor Accuracy
Hyun Joon Jung | Matthew Lease
Advances in Information Retrieval - 37th European Conference on IR Research, ECIR 2015, Vienna, Austria, March 29 - April 2, 2015. Proceedings

2014

doi dblp
Multidimensional relevance modeling via psychometrics and crowdsourcing
Yinglong Zhang | Jin Zhang | Matthew Lease | Jacek Gwizdka
The 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '14, Gold Coast , QLD, Australia - July 06 - 11, 2014

2013

doi dblp
Crowdsourcing for information retrieval: introduction to the special issue
Matthew Lease | Emine Yilmaz
2013 Volume 16 Issue 2

pdf dblp
Overview of the TREC 2013 Crowdsourcing Track
Mark D. Smucker | Gabriella Kazai | Matthew Lease
Proceedings of The Twenty-Second Text REtrieval Conference, TREC 2013, Gaithersburg, Maryland, USA, November 19-22, 2013

2012

pdf dblp
Overview of the TREC 2012 Crowdsourcing Track
Mark D. Smucker | Gabriella Kazai | Matthew Lease
Proceedings of The Twenty-First Text REtrieval Conference, TREC 2012, Gaithersburg, Maryland, USA, November 6-9, 2012

doi dblp
Crowdsourcing for search evaluation and social-algorithmic search
Matthew Lease | Omar Alonso
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012

doi dblp
Parallelizing ListNet training using spark
Shilpa Shukla | Matthew Lease | Ambuj Tewari
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012

doi dblp
Inferring missing relevance judgments from crowd workers via probabilistic matrix factorization
Hyun Joon Jung | Matthew Lease
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012

2011

doi dblp
Crowdsourcing for information retrieval
Matthew Lease | Emine Yilmaz
2011 Volume 45 Issue 2

doi dblp
Crowdsourcing for search and data mining
Matthew Lease | Vitor R. Carvalho | Emine Yilmaz
2011 Volume 45 Issue 1

doi dblp
Crowdsourcing for search and data mining
Vitor R. Carvalho | Matthew Lease | Emine Yilmaz
Proceedings of the Forth International Conference on Web Search and Web Data Mining, WSDM 2011, Hong Kong, China, February 9-12, 2011

doi dblp
Crowdsourcing 101: putting the WSDM of crowds to work for you
Omar Alonso | Matthew Lease
Proceedings of the Forth International Conference on Web Search and Web Data Mining, WSDM 2011, Hong Kong, China, February 9-12, 2011

doi dblp
Crowdsourcing for information retrieval: principles, methods, and applications
Omar Alonso | Matthew Lease
Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, July 25-29, 2011

doi dblp
Learning to rank from a noisy crowd
Abhimanu Kumar | Matthew Lease
Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, July 25-29, 2011

doi dblp
Active learning to maximize accuracy vs. effort in interactive information retrieval
Aibo Tian | Matthew Lease
Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, July 25-29, 2011

doi dblp
Supervised language modeling for temporal resolution of texts
Abhimanu Kumar | Matthew Lease | Jason Baldridge
Proceedings of the 20th ACM Conference on Information and Knowledge Management, CIKM 2011, Glasgow, United Kingdom, October 24-28, 2011

2010

doi dblp
Crowdsourcing for search evaluation
Vitor R. Carvalho | Matthew Lease | Emine Yilmaz
2010 Volume 44 Issue 2

2009

pdf dblp
UMass Amherst and UT Austin @ the TREC 2009 Relevance Feedback Track
Marc-Allen Cartright | Jangwon Seo | Matthew Lease
Proceedings of The Eighteenth Text REtrieval Conference, TREC 2009, Gaithersburg, Maryland, USA, November 17-20, 2009

doi dblp
An improved markov random field model for supporting verbose queries
Matthew Lease
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, July 19-23, 2009

doi dblp
Regression Rank: Learning to Meet the Opportunity of Descriptive Queries
Matthew Lease | James Allan | W. Bruce Croft
Advances in Information Retrieval, 31th European Conference on IR Research, ECIR 2009, Toulouse, France, April 6-9, 2009. Proceedings

2008

pdf dblp
Incorporating Relevance and Pseudo-relevance Feedback in the Markov Random Field Model
Matthew Lease
Proceedings of The Seventeenth Text REtrieval Conference, TREC 2008, Gaithersburg, Maryland, USA, November 18-21, 2008

2007

doi dblp
Natural language processing for information retrieval: the time is ripe (again)
Matthew Lease
Proceedings of the First Ph.D. Workshop in CIKM, PIKM 2007, Sixteenth ACM Conference on Information and Knowledge Management, CIKM 2007, Lisbon, Portugal, November 9, 2007

doi dblp
A Dirichlet-Smoothed Bigram Model for Retrieving Spontaneous Speech
Matthew Lease | Eugene Charniak
Advances in Multilingual and Multimodal Information Retrieval, 8th Workshop of the Cross-Language Evaluation Forum, CLEF 2007, Budapest, Hungary, September 19-21, 2007, Revised Selected Papers

pdf dblp
Brown at CL-SR'07: Retrieving Conversational Speech in English and Czech
Matthew Lease | Eugene Charniak
Working Notes for CLEF 2007 Workshop co-located with the 11th European Conference on Digital Libraries (ECDL 2007), Budapest, Hungary, September 19-21, 2007