2015

doi dblp
Statistical comparisons of non-deterministic IR systems using two dimensional variance
Gaya K. Jayasinghe | William Webber | Mark Sanderson | Lasitha Sandamali Dharmasena | J. Shane Culpepper
2015 Volume 51 Issue 5

2014

doi dblp
Improving test collection pools with machine learning
Gaya K. Jayasinghe | William Webber | Mark Sanderson | J. Shane Culpepper
Proceedings of the 2014 Australasian Document Computing Symposium, ADCS 2014, Melbourne, VIC, Australia, November 27-28, 2014

doi dblp
Extending test collection pools without manual runs
Gaya K. Jayasinghe | William Webber | Mark Sanderson | J. Shane Culpepper
The 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '14, Gold Coast , QLD, Australia - July 06 - 11, 2014

doi dblp
Evaluating non-deterministic retrieval systems
Gaya K. Jayasinghe | William Webber | Mark Sanderson | Lasitha Sandamali Dharmasena | J. Shane Culpepper
The 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '14, Gold Coast , QLD, Australia - July 06 - 11, 2014

doi dblp
Reducing Reliance on Relevance Judgments for System Comparison by Using Expectation-Maximization
Ning Gao | William Webber | Douglas W. Oard
Advances in Information Retrieval - 36th European Conference on IR Research, ECIR 2014, Amsterdam, The Netherlands, April 13-16, 2014. Proceedings

2013

doi dblp
Approximate Recall Confidence Intervals
William Webber
2013 Volume 31 Issue 1

doi dblp
Information Retrieval for E-Discovery
Douglas W. Oard | William Webber
2013 Volume 7 Issue 2-3

pdf dblp
Preface
William Webber | Ruihua Song
Proceedings of the 5th International Workshop on Evaluating Information Access, EVIA 2013, National Center of Sciences, Tokyo, Japan, June 18, 2013

dblp
Proceedings of the 5th International Workshop on Evaluating Information Access, EVIA 2013, National Center of Sciences, Tokyo, Japan, June 18, 2013

Proceedings of the 5th International Workshop on Evaluating Information Access, EVIA 2013, National Center of Sciences, Tokyo, Japan, June 18, 2013

doi dblp
Sequential testing in classifier evaluation yields biased estimates of effectiveness
William Webber | Mossaab Bagdouri | David D. Lewis | Douglas W. Oard
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
Assessor disagreement and text classifier accuracy
William Webber | Jeremy Pickens
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
Document features predicting assessor disagreement
Praveen Chandar | William Webber | Ben Carterette
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
The effect of threshold priming and need for cognition on relevance calibration and assessment
Falk Scholer | Diane Kelly | Wan-Ching Wu | Hanseul S. Lee | William Webber
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
Towards minimizing the annotation cost of certified text classification
Mossaab Bagdouri | William Webber | David D. Lewis | Douglas W. Oard
22nd ACM International Conference on Information and Knowledge Management, CIKM'13, San Francisco, CA, USA, October 27 - November 1, 2013

2012

doi dblp
Effect of written instructions on assessor agreement
William Webber | Bryan Toth | Marjorie Desamito
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012

doi dblp
Alternative assessor disagreement and retrieval depth
William Webber | Praveen Chandar | Ben Carterette
21st ACM International Conference on Information and Knowledge Management, CIKM'12, Maui, HI, USA, October 29 - November 02, 2012

2011

pdf dblp
Reports from Other Evaluation Campaigns and Panel Discussion: TREC is 20 Years Old, Where Now for Evaluation Campaigns?
Mark Sanderson | William Webber | Ian Soboroff | Gareth J. F. Jones | Andrew Trotman | Shlomo Geva | Nicola Ferro | Hideo Joho
Proceedings of the 4th International Workshop on Evaluating Information Access, EVIA 2011, National Center of Sciences, Tokyo, Japan, December 6, 2011

pdf dblp
Preface
Kazuaki Kishida | Mark Sanderson | William Webber
Proceedings of the 4th International Workshop on Evaluating Information Access, EVIA 2011, National Center of Sciences, Tokyo, Japan, December 6, 2011

dblp
Proceedings of the 4th International Workshop on Evaluating Information Access, EVIA 2011, National Center of Sciences, Tokyo, Japan, December 6, 2011

Proceedings of the 4th International Workshop on Evaluating Information Access, EVIA 2011, National Center of Sciences, Tokyo, Japan, December 6, 2011

doi dblp
Principles for robust evaluation infrastructure
Justin Zobel | William Webber | Mark Sanderson | Alistair Moffat
Proceedings of the 2011 Workshop on Data Infrastructures for Supporting Information Retrieval Evaluation, DESIRE '11, Glasgow, Scotland, UK, October 28, 2011

pdf dblp
Melboune at the TREC 2011 Legal Track
William Webber | Phil Farrelly
Proceedings of The Twentieth Text REtrieval Conference, TREC 2011, Gaithersburg, Maryland, USA, November 15-18, 2011

2010

doi dblp
EVIA 2010: the third international workshop on evaluating information access
William Webber | Tetsuya Sakai | Mark Sanderson
2010 Volume 44 Issue 2

doi dblp
A similarity measure for indefinite rankings
William Webber | Alistair Moffat | Justin Zobel
2010 Volume 28 Issue 4

pdf dblp
Preface
Tetsuya Sakai | Mark Sanderson | William Webber
Proceedings of the 3rd International Workshop on Evaluating Information Access, EVIA 2010, National Center of Sciences, Tokyo, Japan, June 15, 2010

pdf dblp
The Effect of Pooling and Evaluation Depth on Metric Stability
William Webber | Alistair Moffat | Justin Zobel
Proceedings of the 3rd International Workshop on Evaluating Information Access, EVIA 2010, National Center of Sciences, Tokyo, Japan, June 15, 2010

dblp
Proceedings of the 3rd International Workshop on Evaluating Information Access, EVIA 2010, National Center of Sciences, Tokyo, Japan, June 15, 2010

Proceedings of the 3rd International Workshop on Evaluating Information Access, EVIA 2010, National Center of Sciences, Tokyo, Japan, June 15, 2010

dblp
The Melbourne Team at the TREC 2010 Legal Track
William Webber | Falk Scholer | Mingfang Wu | Xiuzhen Zhang | Douglas W. Oard | Phil Farrelly | Sandra Potter | Steven Dick | Phill Bertolus
Proceedings of The Nineteenth Text REtrieval Conference, TREC 2010, Gaithersburg, Maryland, USA, November 16-19, 2010

doi dblp
Assessor error in stratified evaluation
William Webber | Douglas W. Oard | Falk Scholer | Bruce Hedin
Proceedings of the 19th ACM Conference on Information and Knowledge Management, CIKM 2010, Toronto, Ontario, Canada, October 26-30, 2010

2009

doi dblp
EvaluatIR: an online tool for evaluating and comparing IR systems
Timothy G. Armstrong | Alistair Moffat | William Webber | Justin Zobel
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, July 19-23, 2009

doi dblp
Has adhoc retrieval improved since 1994?
Timothy G. Armstrong | Alistair Moffat | William Webber | Justin Zobel
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, July 19-23, 2009

doi dblp
Score adjustment for correction of pooling bias
William Webber | Laurence Anthony F. Park
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, July 19-23, 2009

doi dblp
Improvements that don't add up: ad-hoc retrieval results since 1998
Timothy G. Armstrong | Alistair Moffat | William Webber | Justin Zobel
Proceedings of the 18th ACM Conference on Information and Knowledge Management, CIKM 2009, Hong Kong, China, November 2-6, 2009

2008

doi dblp
Precision-at-ten considered redundant
William Webber | Alistair Moffat | Justin Zobel | Tetsuya Sakai
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, Singapore, July 20-24, 2008

doi dblp
Score standardization for inter-collection comparison of retrieval systems
William Webber | Alistair Moffat | Justin Zobel
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, Singapore, July 20-24, 2008

doi dblp
Statistical power in retrieval experimentation
William Webber | Alistair Moffat | Justin Zobel
Proceedings of the 17th ACM Conference on Information and Knowledge Management, CIKM 2008, Napa Valley, California, USA, October 26-30, 2008

2007

doi dblp
A pipelined architecture for distributed text query evaluation
Alistair Moffat | William Webber | Justin Zobel | Ricardo A. Baeza-Yates
2007 Volume 10 Issue 3

doi dblp
Strategic system comparisons via targeted relevance judgments
Alistair Moffat | William Webber | Justin Zobel
SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands, July 23-27, 2007

2006

pdf dblp
Melbourne University at the 2006 Terabyte Track
Vo Ngoc Anh | William Webber | Alistair Moffat
Proceedings of the Fifteenth Text REtrieval Conference, TREC 2006, Gaithersburg, Maryland, USA, November 14-17, 2006

doi dblp
Load balancing for term-distributed parallel retrieval
Alistair Moffat | William Webber | Justin Zobel
SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6-11, 2006

2005

pdf dblp
RMIT University at TREC 2005: Terabyte and Robust Track
Yaniv Bernstein | Bodo Billerbeck | Steven Garcia | Nicholas Lester | Falk Scholer | Justin Zobel | William Webber
Proceedings of the Fourteenth Text REtrieval Conference, TREC 2005, Gaithersburg, Maryland, USA, November 15-18, 2005

pdf dblp
Melbourne University 2005: Enterprise and Terabyte Tasks
Vo Ngoc Anh | William Webber | Alistair Moffat
Proceedings of the Fourteenth Text REtrieval Conference, TREC 2005, Gaithersburg, Maryland, USA, November 15-18, 2005

2004

pdf dblp
RMIT University at TREC 2004
Bodo Billerbeck | Adam Cannane | Abhijit Chattaraj | Nicholas Lester | William Webber | Hugh E. Williams | John Yiannis | Justin Zobel
Proceedings of the Thirteenth Text REtrieval Conference, TREC 2004, Gaithersburg, Maryland, USA, November 16-19, 2004

Search