2022

doi dblp
Relevance Assessments for Web Search Evaluation: Should We Randomise or Prioritise the Pooled Documents?
Tetsuya Sakai | Sijie Tao | Zhaohao Zeng
2022 Volume 40 Issue 4

doi dblp
Do Extractive Summarization Algorithms Amplify Lexical Bias in News Articles?
Rei Shimizu | Sumio Fujita | Tetsuya Sakai
ICTIR '22: The 2022 ACM SIGIR International Conference on the Theory of Information Retrieval, Madrid, Spain, July 11 - 12, 2022

doi dblp
Constructing Better Evaluation Metrics by Incorporating the Anchoring Effect into the User Model
Nuo Chen | Fan Zhang | Tetsuya Sakai
SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022

2021

doi dblp
Retrieval Evaluation Measures that Agree with Users' SERP Preferences: Traditional, Preference-based, and Diversity Measures
Tetsuya Sakai | Zhaohao Zeng
2021 Volume 39 Issue 2

pdf dblp
A Closer Look at Evaluation Measures for Ordinal Quantification
Tetsuya Sakai
Proceedings of the CIKM 2021 Workshops co-located with 30th ACM International Conference on Information and Knowledge Management (CIKM 2021), Gold Coast, Queensland, Australia, November 1-5, 2021

doi dblp
A Fast and Exact Randomisation Test for Comparing Two Systems with Paired Data
Rikiya Suzuki | Tetsuya Sakai
ICTIR '21: The 2021 ACM SIGIR International Conference on the Theory of Information Retrieval, Virtual Event, Canada, July 11, 2021

doi dblp
WWW3E8: 259, 000 Relevance Labels for Studying the Effect of Document Presentation Order for Relevance Assessors
Tetsuya Sakai | Sijie Tao | Zhaohao Zeng
SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021

doi dblp
On the Two-Sample Randomisation Test for IR Evaluation
Tetsuya Sakai
SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021

doi dblp
Scalable Personalised Item Ranking through Parametric Density Estimation
Riku Togashi | Masahiro Kato | Mayu Otani | Tetsuya Sakai | Shin'ichi Satoh
SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021

doi dblp
SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021

SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021

doi dblp
Evaluating Relevance Judgments with Pairwise Discriminative Power
Zhumin Chu | Jiaxin Mao | Fan Zhang | Yiqun Liu | Tetsuya Sakai | Min Zhang | Shaoping Ma
CIKM '21: The 30th ACM International Conference on Information and Knowledge Management, Virtual Event, Queensland, Australia, November 1 - 5, 2021

doi dblp
Incorporating Query Reformulating Behavior into Web Search Evaluation
Jia Chen | Yiqun Liu | Jiaxin Mao | Fan Zhang | Tetsuya Sakai | Weizhi Ma | Min Zhang | Shaoping Ma
CIKM '21: The 30th ACM International Conference on Information and Knowledge Management, Virtual Event, Queensland, Australia, November 1 - 5, 2021

doi dblp
How Do Users Revise Zero-Hit Product Search Queries?
Yuki Amemiya | Tomohiro Manabe | Sumio Fujita | Tetsuya Sakai
Advances in Information Retrieval - 43rd European Conference on IR Research, ECIR 2021, Virtual Event, March 28 - April 1, 2021, Proceedings, Part II

doi dblp
On the Instability of Diminishing Return IR Measures
Tetsuya Sakai
Advances in Information Retrieval - 43rd European Conference on IR Research, ECIR 2021, Virtual Event, March 28 - April 1, 2021, Proceedings, Part I

2020

doi dblp
On Fuhr's guideline for IR evaluation
Tetsuya Sakai
2020 Volume 54 Issue 1

doi dblp
Low-cost, bottom-up measures for evaluating search result diversification
Zhicheng Dou | Xue Yang | Diya Li | Ji-Rong Wen | Tetsuya Sakai
2020 Volume 23 Issue 1

doi dblp
Automatic Evaluation of Iconic Image Retrieval based on Colour, Shape, and Texture
Riku Togashi | Sumio Fujita | Tetsuya Sakai
Proceedings of the 2020 on International Conference on Multimedia Retrieval, ICMR 2020, Dublin, Ireland, June 8-11, 2020

pdf dblp
RealSakaiLab at the TREC 2020 Health Misinformation Track
Sijie Tao | Tetsuya Sakai
Proceedings of the Twenty-Ninth Text REtrieval Conference, TREC 2020, Virtual Event [Gaithersburg, Maryland, USA], November 16-20, 2020

doi dblp
Visual Intents vs. Clicks, Likes, and Purchases in E-commerce
Riku Togashi | Tetsuya Sakai
Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25-30, 2020

doi dblp
Good Evaluation Measures based on Document Preferences
Tetsuya Sakai | Zhaohao Zeng
Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25-30, 2020

doi dblp
How to Measure the Reproducibility of System-oriented IR Experiments
Timo Breuer | Nicola Ferro | Norbert Fuhr | Maria Maistro | Tetsuya Sakai | Philipp Schaer | Ian Soboroff
Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25-30, 2020

2019

doi dblp
Personalized Reason Generation for Explainable Song Recommendation
Guoshuai Zhao | Hao Fu | Ruihua Song | Tetsuya Sakai | Zhongxia Chen | Xing Xie | Xueming Qian
2019 Volume 10 Issue 4

doi dblp
Conducting Laboratory Experiments Properly with Statistical Tools: An Easy Hands-On Tutorial
Tetsuya Sakai
Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, WSDM 2019, Melbourne, VIC, Australia, February 11-15, 2019

doi dblp
Attitude Detection for One-Round Conversation: Jointly Extracting Target-Polarity Pairs
Zhaohao Zeng | Ruihua Song | Pingping Lin | Tetsuya Sakai
Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, WSDM 2019, Melbourne, VIC, Australia, February 11-15, 2019

doi dblp
Generalising Kendall's Tau for Noisy and Incomplete Preference Judgements
Riku Togashi | Tetsuya Sakai
Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2019, Santa Clara, CA, USA, October 2-5, 2019

doi dblp
Generating Short Product Descriptors Based on Very Little Training Data
Peng Xiao | Joo-Young Lee | Sijie Tao | Young-Sook Hwang | Tetsuya Sakai
Information Retrieval Technology - 15th Asia Information Retrieval Societies Conference, AIRS 2019, Hong Kong, November 7-9, 2019, Proceedings

doi dblp
Randomised vs. Prioritised Pools for Relevance Assessments: Sample Size Considerations
Tetsuya Sakai | Peng Xiao
Information Retrieval Technology - 15th Asia Information Retrieval Societies Conference, AIRS 2019, Hong Kong, November 7-9, 2019, Proceedings

doi dblp
Arc Loss: Softmax with Additive Angular Margin for Answer Retrieval
Rikiya Suzuki | Sumio Fujita | Tetsuya Sakai
Information Retrieval Technology - 15th Asia Information Retrieval Societies Conference, AIRS 2019, Hong Kong, November 7-9, 2019, Proceedings

doi dblp
Unsupervised Answer Retrieval with Data Fusion for Community Question Answering
Sosuke Kato | Toru Shimizu | Sumio Fujita | Tetsuya Sakai
Information Retrieval Technology - 15th Asia Information Retrieval Societies Conference, AIRS 2019, Hong Kong, November 7-9, 2019, Proceedings

doi dblp
Towards Automatic Evaluation of Reused Answers in Community Question Answering
Hsin Wen Liu | Sumio Fujita | Tetsuya Sakai
Information Retrieval Technology - 15th Asia Information Retrieval Societies Conference, AIRS 2019, Hong Kong, November 7-9, 2019, Proceedings

doi dblp
The SIGIR 2019 Open-Source IR Replicability Challenge (OSIRRC 2019)
Ryan Clancy | Nicola Ferro | Claudia Hauff | Jimmy Lin | Tetsuya Sakai | Ze Zhong Wu
Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, Paris, France, July 21-25, 2019

doi dblp
Which Diversity Evaluation Measures Are "Good"?
Tetsuya Sakai | Zhaohao Zeng
Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, Paris, France, July 21-25, 2019

pdf dblp
BM25 Pseudo Relevance Feedback Using Anserini at Waseda University
Zhaohao Zeng | Tetsuya Sakai
Proceedings of the Open-Source IR Replicability Challenge co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, OSIRRC@SIGIR 2019, Paris, France, July 25, 2019

pdf dblp
Overview of the 2019 Open-Source IR Replicability Challenge (OSIRRC 2019)
Ryan Clancy | Nicola Ferro | Claudia Hauff | Jimmy Lin | Tetsuya Sakai | Ze Zhong Wu
Proceedings of the Open-Source IR Replicability Challenge co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, OSIRRC@SIGIR 2019, Paris, France, July 25, 2019

dblp
Proceedings of the Open-Source IR Replicability Challenge co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, OSIRRC@SIGIR 2019, Paris, France, July 25, 2019

Proceedings of the Open-Source IR Replicability Challenge co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, OSIRRC@SIGIR 2019, Paris, France, July 25, 2019

pdf dblp
CENTRE@CLEF2019: Overview of the Replicability and Reproducibility Tasks
Nicola Ferro | Norbert Fuhr | Maria Maistro | Tetsuya Sakai | Ian Soboroff
Working Notes of CLEF 2019 - Conference and Labs of the Evaluation Forum, Lugano, Switzerland, September 9-12, 2019

doi dblp
Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm
Nicola Ferro | Norbert Fuhr | Maria Maistro | Tetsuya Sakai | Ian Soboroff
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Lugano, Switzerland, September 9-12, 2019, Proceedings

doi dblp
CENTRE@CLEF 2019
Nicola Ferro | Norbert Fuhr | Maria Maistro | Tetsuya Sakai | Ian Soboroff
Advances in Information Retrieval - 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14-18, 2019, Proceedings, Part II

2018

doi dblp
Laboratory Experiments in Information Retrieval - Sample Sizes, Effect Sizes, and Statistical Power
Tetsuya Sakai
2018 Volume 40

doi dblp
Report on NTCIR-13: The Thirteenth Round of NII Testbeds and Community for Information Access Research
Yiqun Liu | Makoto P. Kato | Charles L. A. Clarke | Noriko Kando | Tetsuya Sakai
2018 Volume 52 Issue 1

doi dblp
Classifying Community QA Questions That Contain an Image
Kenta Tamaki | Riku Togashi | Sosuke Kato | Sumio Fujita | Hideyuki Maeda | Tetsuya Sakai
Proceedings of the 2018 ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2018, Tianjin, China, September 14-17, 2018

doi dblp
Topic Set Size Design for Paired and Unpaired Data
Tetsuya Sakai
Proceedings of the 2018 ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2018, Tianjin, China, September 14-17, 2018

doi dblp
Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Taipei, Taiwan, November 28-30, 2018, Proceedings

Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Taipei, Taiwan, November 28-30, 2018, Proceedings

doi dblp
Conducting Laboratory Experiments Properly with Statistical Tools: An Easy Hands-on Tutorial
Tetsuya Sakai
The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA, July 08-12, 2018

doi dblp
Comparing Two Binned Probability Distributions for Information Access Evaluation
Tetsuya Sakai
The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA, July 08-12, 2018

pdf dblp
CENTRE@CLEF2018: Overview of the Replicability Task
Nicola Ferro | Maria Maistro | Tetsuya Sakai | Ian Soboroff
Working Notes of CLEF 2018 - Conference and Labs of the Evaluation Forum, Avignon, France, September 10-14, 2018

doi dblp
Overview of CENTRE@CLEF 2018: A First Tale in the Systematic Reproducibility Realm
Nicola Ferro | Maria Maistro | Tetsuya Sakai | Ian Soboroff
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Avignon, France, September 10-14, 2018, Proceedings

2017

doi dblp
Overview of Special Issue
James Allan | Nicholas J. Belkin | Paul N. Bennett | Jamie Callan | Charles L. A. Clarke | Fernando Diaz | Susan T. Dumais | Nicola Ferro | Donna Harman | Djoerd Hiemstra | Ian Ruthven | Tetsuya Sakai | Mark D. Smucker | Justin Zobel
2017 Volume 51 Issue 2

pdf dblp
Unanimity-Aware Gain for Highly Subjective Assessments
Tetsuya Sakai
Proceedings of the 8th International Workshop on Evaluating Information Access co-located with the 13th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2017), Tokyo, Japan, December 5, 2017

pdf dblp
The Effect of Inter-Assessor Disagreement on IR System Evaluation: A Case Study with Lancers and Students
Tetsuya Sakai
Proceedings of the 8th International Workshop on Evaluating Information Access co-located with the 13th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2017), Tokyo, Japan, December 5, 2017

pdf dblp
Towards Automatic Evaluation of Multi-Turn Dialogues: A Task Design that Leverages Inherently Subjective Annotations
Tetsuya Sakai
Proceedings of the 8th International Workshop on Evaluating Information Access co-located with the 13th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2017), Tokyo, Japan, December 5, 2017

pdf dblp
Evaluating Evaluation Measures with Worst-Case Confidence Interval Widths
Tetsuya Sakai
Proceedings of the 8th International Workshop on Evaluating Information Access co-located with the 13th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2017), Tokyo, Japan, December 5, 2017

pdf dblp
Test Collections and Measures for Evaluating Customer-Helpdesk Dialogues
Zhaohao Zeng | Cheng Luo | Lifeng Shang | Hang Li | Tetsuya Sakai
Proceedings of the 8th International Workshop on Evaluating Information Access co-located with the 13th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2017), Tokyo, Japan, December 5, 2017

doi dblp
Does Document Relevance Affect the Searcher's Perception of Time?
Cheng Luo | Yiqun Liu | Tetsuya Sakai | Ke Zhou | Fan Zhang | Xue Li | Shaoping Ma
Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, WSDM 2017, Cambridge, United Kingdom, February 6-10, 2017

pdf dblp
SLWWW at the NTCIR-13 WWW Task
Peng Xiao | Lingtao Li | Yimeng Fan | Tetsuya Sakai
The 13th NTCIR Conference, Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, December 5-8, 2017

pdf dblp
SLSTC at the NTCIR-13 STC Task
Jun Guan | Tetsuya Sakai
The 13th NTCIR Conference, Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, December 5-8, 2017

pdf dblp
SLQAL at the NTCIR-13 QA Lab-3 Task
Kou Sato | Tetsuya Sakai
The 13th NTCIR Conference, Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, December 5-8, 2017

pdf dblp
SLOLQ at the NTCIR-13 OpenLiveQ Task
Ryo Kashimura | Tetsuya Sakai
The 13th NTCIR Conference, Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, December 5-8, 2017

pdf dblp
Preface from NTCIR-13 General Chairs
Charles L. A. Clarke | Noriko Kando | Tetsuya Sakai
The 13th NTCIR Conference, Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, December 5-8, 2017

pdf dblp
Overview of the NTCIR-13 Short Text Conversation Task
Lifeng Shang | Tetsuya Sakai | Hang Li | Ryuichiro Higashinaka | Yusuke Miyao | Yuki Arase | Masako Nomoto
The 13th NTCIR Conference, Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, December 5-8, 2017

pdf dblp
Overview of the NTCIR-13 We Want Web Task
Cheng Luo | Tetsuya Sakai | Yiqun Liu | Zhicheng Dou | Chenyan Xiong | Jingfang Xu
The 13th NTCIR Conference, Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, December 5-8, 2017

doi dblp
Mobile Vertical Ranking based on Preference Graphs
Yuta Kadotami | Yasuaki Yoshida | Sumio Fujita | Tetsuya Sakai
Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2017, Amsterdam, The Netherlands, October 1-4, 2017

doi dblp
LSTM vs. BM25 for Open-domain QA: A Hands-on Comparison of Effectiveness and Efficiency
Sosuke Kato | Riku Togashi | Hideyuki Maeda | Sumio Fujita | Tetsuya Sakai
Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7-11, 2017

doi dblp
Evaluating Mobile Search with Height-Biased Gain
Cheng Luo | Yiqun Liu | Tetsuya Sakai | Fan Zhang | Min Zhang | Shaoping Ma
Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7-11, 2017

doi dblp
The Probability that Your Hypothesis Is Correct, Credible Intervals, and Effect Sizes for IR Evaluation
Tetsuya Sakai
Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7-11, 2017

doi dblp
Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7-11, 2017

Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7-11, 2017

doi dblp
Ranking Rich Mobile Verticals based on Clicks and Abandonment
Mami Kawasaki | Inho Kang | Tetsuya Sakai
Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, CIKM 2017, Singapore, November 06 - 10, 2017

doi dblp
Investigating Users' Time Perception during Web Search
Cheng Luo | Xue Li | Yiqun Liu | Tetsuya Sakai | Fan Zhang | Min Zhang | Shaoping Ma
Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval, CHIIR 2017, Oslo, Norway, March 7-11, 2017

2016

doi dblp
Report on NTCIR-12: The Twelfth Round of NII Testbeds and Community for Information Access Research
Makoto P. Kato | Kazuaki Kishida | Noriko Kando | Tetsuya Sakai | Mark Sanderson
2016 Volume 50 Issue 2

doi dblp
Report on the First International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol'2015)
Laure Soulier | Lynda Tamine | Tetsuya Sakai | Leif Azzopardi | Jeremy Pickens
2016 Volume 50 Issue 1

doi dblp
Topic set size design
Tetsuya Sakai
2016 Volume 19 Issue 3

pdf dblp
Two-layered Summaries for Mobile Search: Does the Evaluation Measure Reflect User Preferences?
Makoto P. Kato | Virgil Pavlu | Tetsuya Sakai | Takehiro Yamamoto | Hajime Morita
Proceedings of the Seventh International Workshop on Evaluating Information Access, EVIA 2016, a Satellite Workshop of the NTCIR-12 Conference, National Center of Sciences, Tokyo, Japan, june 7, 2016

pdf dblp
On Estimating Variances for Topic Set Size Design
Tetsuya Sakai | Lifeng Shang
Proceedings of the Seventh International Workshop on Evaluating Information Access, EVIA 2016, a Satellite Workshop of the NTCIR-12 Conference, National Center of Sciences, Tokyo, Japan, june 7, 2016

doi dblp
String Processing and Information Retrieval - 23rd International Symposium, SPIRE 2016, Beppu, Japan, October 18-20, 2016, Proceedings

String Processing and Information Retrieval - 23rd International Symposium, SPIRE 2016, Beppu, Japan, October 18-20, 2016, Proceedings

pdf dblp
SLSTC at the NTCIR-12 STC Task
Hiroto Denawa | Tomoaki Sano | Yuta Kadotami | Sosuke Kato | Tetsuya Sakai
Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, June 7-10, 2016

pdf dblp
SLQAL at the NTCIR-12 QALab-2 Task
Shin Higuchi | Tetsuya Sakai
Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, June 7-10, 2016

pdf dblp
SLLL at the NTCIR-12 Lifelog Task: Sleepflower and the LIT Subtask
Satomi Iijima | Tetsuya Sakai
Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, June 7-10, 2016

pdf dblp
Preface from NTCIR-12 General Chairs
Noriko Kando | Tetsuya Sakai | Mark Sanderson
Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, June 7-10, 2016

pdf dblp
Overview of the NTCIR-12 MobileClick-2 Task
Makoto P. Kato | Tetsuya Sakai | Takehiro Yamamoto | Virgil Pavlu | Hajime Morita | Sumio Fujita
Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, June 7-10, 2016

pdf dblp
Overview of the NTCIR-12 Short Text Conversation Task
Lifeng Shang | Tetsuya Sakai | Zhengdong Lu | Hang Li | Ryuichiro Higashinaka | Yusuke Miyao
Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, June 7-10, 2016

pdf dblp
NEXTI at NTCIR-12 IMine-2 Task
Hidetsugu Nanba | Tetsuya Sakai | Noriko Kando | Atsushi Keyaki | Koji Eguchi | Kenji Hatano | Toshiyuki Shimizu | Yu Hirate | Atsushi Fujii
Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, June 7-10, 2016

dblp
Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, June 7-10, 2016

Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, June 7-10, 2016

doi dblp
Simple and Effective Approach to Score Standardisation
Tetsuya Sakai
Proceedings of the 2016 ACM on International Conference on the Theory of Information Retrieval, ICTIR 2016, Newark, DE, USA, September 12- 6, 2016

doi dblp
Topic Set Size Design and Power Analysis in Practice
Tetsuya Sakai
Proceedings of the 2016 ACM on International Conference on the Theory of Information Retrieval, ICTIR 2016, Newark, DE, USA, September 12- 6, 2016

doi dblp
The Effect of Score Standardisation on Topic Set Size Design
Tetsuya Sakai
Information Retrieval Technology - 12th Asia Information Retrieval Societies Conference, AIRS 2016, Beijing, China, November 30 - December 2, 2016, Proceedings

doi dblp
Two Sample T-tests for IR Evaluation: Student or Welch?
Tetsuya Sakai
Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy, July 17-21, 2016

doi dblp
Evaluating Search Result Diversity using Intent Hierarchies
Xiaojie Wang | Zhicheng Dou | Tetsuya Sakai | Ji-Rong Wen
Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy, July 17-21, 2016

doi dblp
Statistical Significance, Power, and Sample Sizes: A Systematic Review of SIGIR and TOIS, 2006-2015
Tetsuya Sakai
Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy, July 17-21, 2016

2015

doi dblp
Dynamic author name disambiguation for growing digital libraries
Ya-nan Qian | Qinghua Zheng | Tetsuya Sakai | Junting Ye | Jun Liu
2015 Volume 18 Issue 5

dblp
Proceedings of the 2015 Workshop on Evaluation on Collaborative Information Retrieval and Seeking, ECol 2015, Melbourne, Australia, October 23, 2015

Proceedings of the 2015 Workshop on Evaluation on Collaborative Information Retrieval and Seeking, ECol 2015, Melbourne, Australia, October 23, 2015

pdf dblp
TREC 2015 Temporal Summarization Track Overview
Javed A. Aslam | Fernando Diaz | Matthew Ekstrand-Abueg | Richard McCreadie | Virgil Pavlu | Tetsuya Sakai
Proceedings of The Twenty-Fourth Text REtrieval Conference, TREC 2015, Gaithersburg, Maryland, USA, November 17-20, 2015

doi dblp
Topic Set Size Design with the Evaluation Measures for Short Text Conversation
Tetsuya Sakai | Lifeng Shang | Zhengdong Lu | Hang Li
Information Retrieval Technology - 11th Asia Information Retrieval Societies Conference, AIRS 2015, Brisbane, QLD, Australia, December 2-4, 2015. Proceedings

doi dblp
ECol 2015: First international workshop on the Evaluation on Collaborative Information Seeking and Retrieval
Leif Azzopardi | Jeremy Pickens | Tetsuya Sakai | Laure Soulier | Lynda Tamine
Proceedings of the 24th ACM International Conference on Information and Knowledge Management, CIKM 2015, Melbourne, VIC, Australia, October 19 - 23, 2015

doi dblp
Search Result Diversification Based on Hierarchical Intents
Sha Hu | Zhicheng Dou | Xiaojie Wang | Tetsuya Sakai | Ji-Rong Wen
Proceedings of the 24th ACM International Conference on Information and Knowledge Management, CIKM 2015, Melbourne, VIC, Australia, October 19 - 23, 2015

2014

doi dblp
Statistical reform in information retrieval?
Tetsuya Sakai
2014 Volume 48 Issue 1

pdf dblp
Topic Set Size Design with Variance Estimates from Two-Way ANOVA
Tetsuya Sakai
Proceedings of the Sixth International Workshop on Evaluating Information Access, EVIA 2014, National Center of Sciences, Tokyo, Japan, December 9, 2014

pdf dblp
TREC 2014 Temporal Summarization Track Overview
Javed A. Aslam | Matthew Ekstrand-Abueg | Virgil Pavlu | Fernando Diaz | Richard McCreadie | Tetsuya Sakai
Proceedings of The Twenty-Third Text REtrieval Conference, TREC 2014, Gaithersburg, Maryland, USA, November 19-21, 2014

pdf dblp
Preface from NTCIR-11 General Chairs
Noriko Kando | Tsuneaki Kato | Tetsuya Sakai | Douglas W. Oard | Mark Sanderson
Proceedings of the 11th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR-11, National Center of Sciences, Tokyo, Japan, December 9-12, 2014

pdf dblp
Overview of the NTCIR-11 MobileClick Task
Makoto P. Kato | Matthew Ekstrand-Abueg | Virgil Pavlu | Tetsuya Sakai | Takehiro Yamamoto | Mayu Iwata
Proceedings of the 11th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR-11, National Center of Sciences, Tokyo, Japan, December 9-12, 2014

doi dblp
Designing Test Collections for Comparing Many Systems
Tetsuya Sakai
Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, CIKM 2014, Shanghai, China, November 3-7, 2014

2013

doi dblp
Asian summer school in information access (ASSIA 2013)
Hideo Joho | Noriko Kando | Tetsuya Sakai | Yohei Seki | Shigeo Sugimoto
2013 Volume 47 Issue 2

doi dblp
When do people use query suggestion? A query suggestion log analysis
Makoto P. Kato | Tetsuya Sakai | Katsumi Tanaka
2013 Volume 16 Issue 6

doi dblp
Diversified search evaluation: lessons from the NTCIR-9 INTENT task
Tetsuya Sakai | Ruihua Song
2013 Volume 16 Issue 4

doi dblp
Mining subtopics from text fragments for a web query
Qinglei Wang | Ya-nan Qian | Ruihua Song | Zhicheng Dou | Fan Zhang | Tetsuya Sakai | Qinghua Zheng
2013 Volume 16 Issue 4

doi dblp
Introduction to the special issue on search intents and diversification
Tetsuya Sakai | Noriko Kando | Craig Macdonald | Ian Soboroff
2013 Volume 16 Issue 4

pdf dblp
The Unreusability of Diversified Search Test Collections
Tetsuya Sakai
Proceedings of the 5th International Workshop on Evaluating Information Access, EVIA 2013, National Center of Sciences, Tokyo, Japan, June 18, 2013

pdf dblp
TREC 2013 Temporal Summarization
Javed A. Aslam | Matthew Ekstrand-Abueg | Virgil Pavlu | Fernando Diaz | Tetsuya Sakai
Proceedings of The Twenty-Second Text REtrieval Conference, TREC 2013, Gaithersburg, Maryland, USA, November 19-22, 2013

pdf dblp
Wrap Up of NTCIR-10
Hideo Joho | Tetsuya Sakai
Proceedings of the 10th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR-10, National Center of Sciences, Tokyo, Japan, June 18-21, 2013

pdf dblp
Overview of the NTCIR-10 1CLICK-2 Task
Makoto P. Kato | Matthew Ekstrand-Abueg | Virgil Pavlu | Tetsuya Sakai | Takehiro Yamamoto | Mayu Iwata
Proceedings of the 10th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR-10, National Center of Sciences, Tokyo, Japan, June 18-21, 2013

pdf dblp
Overview of the NTCIR-10 INTENT-2 Task
Tetsuya Sakai | Zhicheng Dou | Takehiro Yamamoto | Yiqun Liu | Min Zhang | Ruihua Song
Proceedings of the 10th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR-10, National Center of Sciences, Tokyo, Japan, June 18-21, 2013

pdf dblp
Overview of NTCIR-10
Hideo Joho | Tetsuya Sakai
Proceedings of the 10th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR-10, National Center of Sciences, Tokyo, Japan, June 18-21, 2013

pdf dblp
Microsoft Research Asia at the NTCIR-10 Intent Task
Kosetsu Tsukuda | Zhicheng Dou | Tetsuya Sakai
Proceedings of the 10th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR-10, National Center of Sciences, Tokyo, Japan, June 18-21, 2013

pdf dblp
MSRA at NTCIR-10 1CLICK-2
Kazuya Narita | Tetsuya Sakai | Zhicheng Dou | Young-In Song
Proceedings of the 10th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR-10, National Center of Sciences, Tokyo, Japan, June 18-21, 2013

doi dblp
User-Aware Advertisability
Haitao Yu | Tetsuya Sakai
Information Retrieval Technology - 9th Asia Information Retrieval Societies Conference, AIRS 2013, Singapore, December 9-11, 2013. Proceedings

doi dblp
On Labelling Intent Types for Evaluating Search Result Diversification
Tetsuya Sakai | Young-In Song
Information Retrieval Technology - 9th Asia Information Retrieval Societies Conference, AIRS 2013, Singapore, December 9-11, 2013. Proceedings

doi dblp
Estimating Intent Types for Search Result Diversification
Kosetsu Tsukuda | Tetsuya Sakai | Zhicheng Dou | Katsumi Tanaka
Information Retrieval Technology - 9th Asia Information Retrieval Societies Conference, AIRS 2013, Singapore, December 9-11, 2013. Proceedings

doi dblp
How Intuitive Are Diversified Search Metrics? Concordance Test Results for the Diversity U-Measures
Tetsuya Sakai
Information Retrieval Technology - 9th Asia Information Retrieval Societies Conference, AIRS 2013, Singapore, December 9-11, 2013. Proceedings

doi dblp
The impact of intent selection on diversified search evaluation
Tetsuya Sakai | Zhicheng Dou | Charles L. A. Clarke
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
Time-aware structured query suggestion
Taiki Miyanishi | Tetsuya Sakai
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
Summary of the NTCIR-10 INTENT-2 task: subtopic mining and search result diversification
Tetsuya Sakai | Zhicheng Dou | Takehiro Yamamoto | Yiqun Liu | Min Zhang | Makoto P. Kato | Ruihua Song | Mayu Iwata
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
Report from the NTCIR-10 1CLICK-2 Japanese subtask: baselines, upperbounds and evaluation robustness
Makoto P. Kato | Tetsuya Sakai | Takehiro Yamamoto | Mayu Iwata
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
Exploring semi-automatic nugget extraction for Japanese one click access evaluation
Matthew Ekstrand-Abueg | Virgil Pavlu | Makoto P. Kato | Tetsuya Sakai | Takehiro Yamamoto | Mayu Iwata
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
Summaries, ranked retrieval and sessions: a unified framework for information access evaluation
Tetsuya Sakai | Zhicheng Dou
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
Dynamic query intent mining from a search log stream
Ya-nan Qian | Tetsuya Sakai | Junting Ye | Qinghua Zheng | Cong Li
22nd ACM International Conference on Information and Knowledge Management, CIKM'13, San Francisco, CA, USA, October 27 - November 1, 2013

doi dblp
On the reliability and intuitiveness of aggregated search metrics
Ke Zhou | Mounia Lalmas | Tetsuya Sakai | Ronan Cummins | Joemon M. Jose
22nd ACM International Conference on Information and Knowledge Management, CIKM'13, San Francisco, CA, USA, October 27 - November 1, 2013

2012

doi dblp
Grid-Based Interaction for Exploratory Search
Hideo Joho | Tetsuya Sakai
Information Retrieval Technology, 8th Asia Information Retrieval Societies Conference, AIRS 2012, Tianjin, China, December 17-19, 2012. Proceedings

doi dblp
One Click One Revisited: Enhancing Evaluation Based on Information Units
Tetsuya Sakai | Makoto P. Kato
Information Retrieval Technology, 8th Asia Information Retrieval Societies Conference, AIRS 2012, Tianjin, China, December 17-19, 2012. Proceedings

doi dblp
The Reusability of a Diversified Search Test Collection
Tetsuya Sakai | Zhicheng Dou | Ruihua Song | Noriko Kando
Information Retrieval Technology, 8th Asia Information Retrieval Societies Conference, AIRS 2012, Tianjin, China, December 17-19, 2012. Proceedings

doi dblp
Towards zero-click mobile IR evaluation: knowing what and knowing when
Tetsuya Sakai
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012

doi dblp
New assessment criteria for query suggestion
Zhongrui Ma | Yu Chen | Ruihua Song | Tetsuya Sakai | Jiaheng Lu | Ji-Rong Wen
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012

doi dblp
AspecTiles: tile-based visualization of diversified web search results
Mayu Iwata | Tetsuya Sakai | Takehiro Yamamoto | Yu Chen | Yi Liu | Ji-Rong Wen | Shojiro Nishio
The 35th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '12, Portland, OR, USA, August 12-16, 2012

doi dblp
The wisdom of advertisers: mining subgoals via query clustering
Takehiro Yamamoto | Tetsuya Sakai | Mayu Iwata | Chen Yu | Ji-Rong Wen | Katsumi Tanaka
21st ACM International Conference on Information and Knowledge Management, CIKM'12, Maui, HI, USA, October 29 - November 02, 2012

doi dblp
Evaluation with informational and navigational intents
Tetsuya Sakai
Proceedings of the 21st World Wide Web Conference 2012, WWW 2012, Lyon, France, April 16-20, 2012

doi dblp
Structured query suggestion for specialization and parallel movement: effect on search behaviors
Makoto P. Kato | Tetsuya Sakai | Katsumi Tanaka
Proceedings of the 21st World Wide Web Conference 2012, WWW 2012, Lyon, France, April 16-20, 2012

2011

pdf dblp
What Makes a Good Answer in Community Question Answering? An Analysis of Assessors' Criteria
Daisuke Ishikawa | Noriko Kando | Tetsuya Sakai
Proceedings of the 4th International Workshop on Evaluating Information Access, EVIA 2011, National Center of Sciences, Tokyo, Japan, December 6, 2011

pdf dblp
TTOKU Summarization Based Systems at NTCIR-9 1CLICK task
Hajime Morita | Takuya Makino | Tetsuya Sakai | Hiroya Takamura | Manabu Okumura
Proceedings of the 9th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-9, National Center of Sciences, Tokyo, Japan, December 6-9, 2011

pdf dblp
Overview of the NTCIR-9 INTENT Task
Ruihua Song | Min Zhang | Tetsuya Sakai | Makoto P. Kato | Yiqun Liu | Miho Sugimoto | Qinglei Wang | Naoki Orii
Proceedings of the 9th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-9, National Center of Sciences, Tokyo, Japan, December 6-9, 2011

pdf dblp
Overview of NTCIR-9
Tetsuya Sakai | Hideo Joho
Proceedings of the 9th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-9, National Center of Sciences, Tokyo, Japan, December 6-9, 2011

pdf dblp
Overview of NTCIR-9 1CLICK
Tetsuya Sakai | Makoto P. Kato | Young-In Song
Proceedings of the 9th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-9, National Center of Sciences, Tokyo, Japan, December 6-9, 2011

pdf dblp
Microsoft Research Asia at the NTCIR-9 Intent Task
Jialong Han | Qinglei Wang | Naoki Orii | Zhicheng Dou | Tetsuya Sakai | Ruihua Song
Proceedings of the 9th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-9, National Center of Sciences, Tokyo, Japan, December 6-9, 2011

pdf dblp
Microsoft Research Asia at the NTCIR-9 1CLICK Task
Naoki Orii | Young-In Song | Tetsuya Sakai
Proceedings of the 9th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-9, National Center of Sciences, Tokyo, Japan, December 6-9, 2011

pdf dblp
Grid-based Interaction for NTCIR-9 VisEx Task
Hideo Joho | Tetsuya Sakai
Proceedings of the 9th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-9, National Center of Sciences, Tokyo, Japan, December 6-9, 2011

doi dblp
Using graded-relevance metrics for evaluating community QA answer selection
Tetsuya Sakai | Daisuke Ishikawa | Noriko Kando | Yohei Seki | Kazuko Kuriyama | Chin-Yew Lin
Proceedings of the Forth International Conference on Web Search and Web Data Mining, WSDM 2011, Hong Kong, China, February 9-12, 2011

doi dblp
Evaluating diversified search results using per-intent graded relevance
Tetsuya Sakai | Ruihua Song
Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, July 25-29, 2011

doi dblp
Click the search button and be happy: evaluating direct and immediate information access
Tetsuya Sakai | Makoto P. Kato | Young-In Song
Proceedings of the 20th ACM Conference on Information and Knowledge Management, CIKM 2011, Glasgow, United Kingdom, October 24-28, 2011

2010

doi dblp
EVIA 2010: the third international workshop on evaluating information access
William Webber | Tetsuya Sakai | Mark Sanderson
2010 Volume 44 Issue 2

pdf dblp
Microsoft Research Asia with Redmond at the NTCIR-8 Community QA Pilot Task
Young-In Song | Jing Liu | Tetsuya Sakai | Xin-Jing Wang | Guwen Feng | Yunbo Cao | Hisami Suzuki | Chin-Yew Lin
Proceedings of the 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-8, National Center of Sciences, Tokyo, Japan, June 15-18, 2010

pdf dblp
Overview of the NTCIR-8 Community QA Pilot Task (Part II): System Evaluation
Tetsuya Sakai | Daisuke Ishikawa | Noriko Kando
Proceedings of the 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-8, National Center of Sciences, Tokyo, Japan, June 15-18, 2010

pdf dblp
Overview of the NTCIR-8 Community QA Pilot Task (Part I): The Test Collection and the Task
Daisuke Ishikawa | Tetsuya Sakai | Noriko Kando
Proceedings of the 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-8, National Center of Sciences, Tokyo, Japan, June 15-18, 2010

pdf dblp
NTCIR-GeoTime Overview: Evaluating Geographic and Temporal Search
Fredric C. Gey | Ray R. Larson | Noriko Kando | Jorge Machado | Tetsuya Sakai
Proceedings of the 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-8, National Center of Sciences, Tokyo, Japan, June 15-18, 2010

pdf dblp
Overview of NTCIR-8 ACLIA IR4QA
Tetsuya Sakai | Hideki Shima | Noriko Kando | Ruihua Song | Chuan-Jie Lin | Teruko Mitamura | Miho Sugimoto | Cheng-Wei Lee
Proceedings of the 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-8, National Center of Sciences, Tokyo, Japan, June 15-18, 2010

pdf dblp
Overview of the NTCIR-8 ACLIA Tasks: Advanced Cross-Lingual Information Access
Teruko Mitamura | Hideki Shima | Tetsuya Sakai | Noriko Kando | Tatsunori Mori | Koichi Takeda | Chin-Yew Lin | Ruihua Song | Chuan-Jie Lin | Cheng-Wei Lee
Proceedings of the 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-8, National Center of Sciences, Tokyo, Japan, June 15-18, 2010

pdf dblp
Preface
Tetsuya Sakai | Mark Sanderson | William Webber
Proceedings of the 3rd International Workshop on Evaluating Information Access, EVIA 2010, National Center of Sciences, Tokyo, Japan, June 15, 2010

pdf dblp
Constructing a Test Collection with Multi-Intent Queries
Ruihua Song | Dongjie Qi | Hua Liu | Tetsuya Sakai | Jian-Yun Nie | Hsiao-Wuen Hon | Yong Yu
Proceedings of the 3rd International Workshop on Evaluating Information Access, EVIA 2010, National Center of Sciences, Tokyo, Japan, June 15, 2010

pdf dblp
Simple Evaluation Metrics for Diversified Search Results
Tetsuya Sakai | Nick Craswell | Ruihua Song | Stephen Robertson | Zhicheng Dou | Chin-Yew Lin
Proceedings of the 3rd International Workshop on Evaluating Information Access, EVIA 2010, National Center of Sciences, Tokyo, Japan, June 15, 2010

pdf dblp
Ranking Retrieval Systems without Relevance Assessments: Revisited
Tetsuya Sakai | Chin-Yew Lin
Proceedings of the 3rd International Workshop on Evaluating Information Access, EVIA 2010, National Center of Sciences, Tokyo, Japan, June 15, 2010

dblp
Proceedings of the 3rd International Workshop on Evaluating Information Access, EVIA 2010, National Center of Sciences, Tokyo, Japan, June 15, 2010

Proceedings of the 3rd International Workshop on Evaluating Information Access, EVIA 2010, National Center of Sciences, Tokyo, Japan, June 15, 2010

dblp
Boiling down information retrieval test collections
Tetsuya Sakai | Teruko Mitamura
Recherche d'Information Assistée par Ordinateur, RIAO 2010: Adaptivity, Personalization and Fusion of Heterogeneous Information, 9th International Conference, Bibliotheque Nationale de France, Paris, France, April 28-30, 2010, Proceedings

2009

doi dblp
EVIA 2008: the second international workshop on evaluating information access
Tetsuya Sakai | Mark Sanderson | Noriko Kando
2009 Volume 43 Issue 1

doi dblp
Report on the SIGIR 2009 workshop on the future of IR evaluation
Jaap Kamps | Shlomo Geva | Carol Peters | Tetsuya Sakai | Andrew Trotman | Ellen M. Voorhees
2009 Volume 43 Issue 2

doi dblp
Information Retrieval Technology, 5th Asia Information Retrieval Symposium, AIRS 2009, Sapporo, Japan, October 21-23, 2009. Proceedings

Information Retrieval Technology, 5th Asia Information Retrieval Symposium, AIRS 2009, Sapporo, Japan, October 21-23, 2009. Proceedings

doi dblp
Serendipitous search via wikipedia: a query log analysis
Tetsuya Sakai | Kenichi Nogami
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, July 19-23, 2009

2008

doi dblp
On information retrieval metrics designed for evaluation with incomplete relevance assessments
Tetsuya Sakai | Noriko Kando
2008 Volume 11 Issue 5

pdf dblp
Overview of the NTCIR-7 ACLIA IR4QA Task
Tetsuya Sakai | Noriko Kando | Chuan-Jie Lin | Teruko Mitamura | Hideki Shima | Donghong Ji | Kuang-hua Chen | Eric Nyberg
Proceedings of the 7th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-7, National Center of Sciences, Tokyo, Japan, December 16-19, 2008

pdf dblp
Overview of the NTCIR-7 ACLIA Tasks: Advanced Cross-Lingual Information Access
Teruko Mitamura | Eric Nyberg | Hideki Shima | Tsuneaki Kato | Tatsunori Mori | Chin-Yew Lin | Ruihua Song | Chuan-Jie Lin | Tetsuya Sakai | Donghong Ji | Noriko Kando
Proceedings of the 7th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-7, National Center of Sciences, Tokyo, Japan, December 16-19, 2008

pdf dblp
NTCIR-7 ACLIA IR4QA Results based on Qrels Version 2
Tetsuya Sakai | Noriko Kando | Chuan-Jie Lin | Ruihua Song | Hideki Shima | Teruko Mitamura
Proceedings of the 7th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-7, National Center of Sciences, Tokyo, Japan, December 16-19, 2008

pdf dblp
Modelling A User Population for Designing Information Retrieval Metrics
Tetsuya Sakai | Stephen Robertson
Proceedings of the 2nd International Workshop on Evaluating Information Access, EVIA 2008, National Center of Sciences, Tokyo, Japan, December 16, 2008

pdf dblp
Are Popular Documents More Likely To Be Relevant? A Dive into the ACLIA IR4QA Pools
Tetsuya Sakai | Noriko Kando
Proceedings of the 2nd International Workshop on Evaluating Information Access, EVIA 2008, National Center of Sciences, Tokyo, Japan, December 16, 2008

dblp
Proceedings of the 2nd International Workshop on Evaluating Information Access, EVIA 2008, National Center of Sciences, Tokyo, Japan, December 16, 2008

Proceedings of the 2nd International Workshop on Evaluating Information Access, EVIA 2008, National Center of Sciences, Tokyo, Japan, December 16, 2008

doi dblp
Information Retrieval Technology, 4th Asia Infomation Retrieval Symposium, AIRS 2008, Harbin, China, January 15-18, 2008, Revised Selected Papers

Information Retrieval Technology, 4th Asia Infomation Retrieval Symposium, AIRS 2008, Harbin, China, January 15-18, 2008, Revised Selected Papers

doi dblp
Precision-at-ten considered redundant
William Webber | Alistair Moffat | Justin Zobel | Tetsuya Sakai
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, Singapore, July 20-24, 2008

doi dblp
Comparing metrics across TREC and NTCIR: : the robustness to pool depth bias
Tetsuya Sakai
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, Singapore, July 20-24, 2008

doi dblp
Comparing metrics across TREC and NTCIR: the robustness to system bias
Tetsuya Sakai
Proceedings of the 17th ACM Conference on Information and Knowledge Management, CIKM 2008, Napa Valley, California, USA, October 26-30, 2008

2007

doi dblp
EVIA 2007: the First International Workshop on Evaluating Information Access
Mark Sanderson | Tetsuya Sakai | Noriko Kando
2007 Volume 41 Issue 2

doi dblp
On the reliability of information retrieval metrics based on graded relevance
Tetsuya Sakai
2007 Volume 43 Issue 2

pdf dblp
Toshiba BRIDJE at NTCIR-6 CLIR: The Head/Lead Method and Graded Relevance Feedback
Tetsuya Sakai | Makoto Koyama | Tatsuya Izuha | Akira Kumano | Toshihiko Manabe | Tomoharu Kokubu
Proceedings of the 6th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-6, National Center of Sciences, Tokyo, Japan, May 15-18, 2007

pdf dblp
User Satisfaction Task: A Proposal for NTCIR-7
Tetsuya Sakai
Proceedings of the 1st International Workshop on Evaluating Information Access, EVIA 2007, National Center of Sciences, Tokyo, Japan, May 15, 2008

pdf dblp
On Penalising Late Arrival of Relevant Documents in Information Retrieval Evaluation with Graded Relevance
Tetsuya Sakai
Proceedings of the 1st International Workshop on Evaluating Information Access, EVIA 2007, National Center of Sciences, Tokyo, Japan, May 15, 2008

dblp
Pic-A-Topic: Efficient Viewing of Informative TV Contents on Travel, Cooking, Food and More
Tetsuya Sakai | Tatsuya Uehara | Taishi Shimomori | Makoto Koyama | Mika Fukui
Computer-Assisted Information Retrieval (Recherche d'Information et ses Applications) - RIAO 2007, 8th International Conference, Carnegie Mellon University, Pittsburgh, PA, USA, May 30 - June 1, 2007. Proceedings, CD-ROM

doi dblp
Alternatives to Bpref
Tetsuya Sakai
SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands, July 23-27, 2007

2006

doi dblp
Pic-A-Topic: Gathering Information Efficiently from Recorded TV Shows on Travel
Tetsuya Sakai | Tatsuya Uehara | Kazuo Sumita | Taishi Shimomori
Information Retrieval Technology, Third Asia Information Retrieval Symposium, AIRS 2006, Singapore, October 16-18, 2006, Proceedings

doi dblp
Bootstrap-Based Comparisons of IR Metrics for Finding One Relevant Document
Tetsuya Sakai
Information Retrieval Technology, Third Asia Information Retrieval Symposium, AIRS 2006, Singapore, October 16-18, 2006, Proceedings

doi dblp
Improving the Robustness to Recognition Errors in Speech Input Question Answering
Hideki Tsutsui | Toshihiko Manabe | Mika Fukui | Tetsuya Sakai | Hiroko Fujii | Koji Urata
Information Retrieval Technology, Third Asia Information Retrieval Symposium, AIRS 2006, Singapore, October 16-18, 2006, Proceedings

doi dblp
Give me just one highly relevant document: P-measure
Tetsuya Sakai
SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6-11, 2006

doi dblp
Evaluating evaluation metrics based on the bootstrap
Tetsuya Sakai
SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6-11, 2006

2005

pdf dblp
Toshiba BRIDJE at NTCIR-5 CLIR: Evaluation using Geometric Means
Tetsuya Sakai | Toshihiko Manabe | Akira Kumano | Makoto Koyama | Tomoharu Kokubu
Proceedings of the Fifth NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-5, National Center of Sciences, Tokyo, Japan, December 6-9, 2005

pdf dblp
The Relationship between Answer Ranking and User Satisfaction in a Question Answering System
Tomoharu Kokubu | Tetsuya Sakai | Yoshimi Saito | Hideki Tsutsui | Toshihiko Manabe | Makoto Koyama | Hiroko Fujii
Proceedings of the Fifth NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-5, National Center of Sciences, Tokyo, Japan, December 6-9, 2005

pdf dblp
The Effect of Topic Sampling on Sensitivity Comparisons of Information Retrieval Metrics
Tetsuya Sakai
Proceedings of the Fifth NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-5, National Center of Sciences, Tokyo, Japan, December 6-9, 2005

doi dblp
The Reliability of Metrics Based on Graded Relevance
Tetsuya Sakai
Information Retrieval Technology, Second Asia Information Retrieval Symposium, AIRS 2005, Jeju Island, Korea, October 13-15, 2005, Proceedings

2004

pdf dblp
Toshiba BRIDJE at NTCIR-4 CLIR: Monolingual/Bilingual IR and Flexible Feedback
Tetsuya Sakai | Makoto Koyama | Akira Kumano | Toshihiko Manabe
Proceedings of the Fourth NTCIR Workshop on Research in Information Access Technologies Information Retrieval, Question Answering and Summarization, NTCIR-4, National Center of Sciences, Tokyo, Japan, June 2-4, 2004

pdf dblp
Toshiba ASKMi at NTCIR-4 QAC2
Tetsuya Sakai | Yoshimi Saito | Yumi Ichimura | Makoto Koyama | Tomoharu Kokubu
Proceedings of the Fourth NTCIR Workshop on Research in Information Access Technologies Information Retrieval, Question Answering and Summarization, NTCIR-4, National Center of Sciences, Tokyo, Japan, June 2-4, 2004

pdf dblp
New Performance Metrics Based on Multigrade Relevance: Their Application to Question Answering
Tetsuya Sakai
Proceedings of the Fourth NTCIR Workshop on Research in Information Access Technologies Information Retrieval, Question Answering and Summarization, NTCIR-4, National Center of Sciences, Tokyo, Japan, June 2-4, 2004

dblp
ASKMi: A Japanese Question Answering System based on Semantic Role Analysis
Tetsuya Sakai | Yoshimi Saito | Yumi Ichimura | Makoto Koyama | Tomoharu Kokubu | Toshihiko Manabe
Computer-Assisted Information Retrieval (Recherche d'Information et ses Applications) - RIAO 2004, 7th International Conference, University of Avignon, France, April 26-28, 2004. Proceedings

doi dblp
Ranking the NTCIR Systems Based on Multigrade Relevance
Tetsuya Sakai
Information Retrieval Technology, Asia Information Retrieval Symposium, AIRS 2004, Beijing, China, October 18-20, 2004, Revised Selected Papers

doi dblp
The effect of back-formulating questions in question answering evaluation
Tetsuya Sakai | Yoshimi Saito | Yumi Ichimura | Tomoharu Kokubu | Makoto Koyama
SIGIR 2004: Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Sheffield, UK, July 25-29, 2004

2003

doi dblp
Evaluating retrieval performance for Japanese question answering: what are best passages?
Tetsuya Sakai | Tomoharu Kokubu
SIGIR 2003: Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, July 28 - August 1, 2003, Toronto, Canada

doi dblp
Average gain ratio: a simple retrieval performance measure for evaluation with multiple relevance levels
Tetsuya Sakai
SIGIR 2003: Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, July 28 - August 1, 2003, Toronto, Canada

2002

pdf dblp
Toshiba KIDS at NTCIR-3: Japanese and English-Japanese IR
Tetsuya Sakai | Makoto Koyama | Masaru Suzuki | Toshihiko Manabe
Proceedings of the Third NTCIR Workshop on Research in Information Retrieval, Automatic Text Summarization and Question Answering, NTCIR-3, Tokyo, Japan, October 8-10, 2002

doi dblp
Relative and absolute term selection criteria: a comparative study for English and Japanese IR
Tetsuya Sakai | Stephen E. Robertson
SIGIR 2002: Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, August 11-15, 2002, Tampere, Finland

2001

pdf dblp
Flexible Pseudo-Relevance Feedback for NTCIR-2
Tetsuya Sakai | Stephen E. Robertson | Stephen Walker
Proceedings of the Third Second Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization, NTCIR-2, Tokyo, Japan, March 7-9, 2001

doi dblp
Flexible Pseudo-Relevance Feedback Using Optimization Tables
Tetsuya Sakai | Stephen E. Robertson
SIGIR 2001: Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, September 9-13, 2001, New Orleans, Louisiana, USA

doi dblp
Generic Summaries for Indexing in Information Retrieval
Tetsuya Sakai | Karen Sparck Jones
SIGIR 2001: Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, September 9-13, 2001, New Orleans, Louisiana, USA

2000

doi dblp
Incremental Relevance Feedback in Japanese Text Retrieval
Gareth J. F. Jones | Tetsuya Sakai | Masahiro Kajiura | Kazuo Sumita
2000 Volume 2 Issue 4

1999

doi dblp
BMIR-J2: A Test Collection for Evaluation of Japanese Information Retrieval Systems
Tetsuya Sakai | Tsuyoshi Kitani | Yasushi Ogawa | Tetsuya Ishikawa | Haruo Kimoto | Ikuo Keshi | Jun Toyoura | Toshikazu Fukushima | Kunio Matsui | Yoshihiro Ueda | Takenobu Tokunaga | Hiroshi Tsuruoka | Hidekazu Nakawatase | Teru Agata | Noriko Kando
1999 Volume 33 Issue 1

pdf dblp
Cross-Language Information Retrieval for NTCIR at Toshiba
Tetsuya Sakai | Yasuyo Shibazaki | Masaru Suzuki | Masahiro Kajiura | Toshihiko Manabe | Kazuo Sumita
Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition, NTCIR-1, Tokyo, Japan, August 30 - September 1, 1999

doi dblp
A Comparison of Query Translation Methods for English-Japanese Cross-Language Information Retrieval (poster abstract)
Gareth J. F. Jones | Tetsuya Sakai | Nigel Collier | Akira Kumano | Kazuo Sumita
SIGIR '99: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, August 15-19, 1999, Berkeley, CA, USA

1998

doi dblp
Lessons from BMIR-J2: A Test Collection for Japanese IR Systems
Tsuyoshi Kitani | Yasushi Ogawa | Tetsuya Ishikawa | Haruo Kimoto | Ikuo Keshi | Jun Toyoura | Toshikazu Fukushima | Kunio Matsui | Yoshihiro Ueda | Tetsuya Sakai | Takenobu Tokunaga | Hiroshi Tsuruoka | Hidekazu Nakawatase | Teru Agata
SIGIR '98: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, August 24-28 1998, Melbourne, Australia

doi dblp
Experiments in Japanese Text Retrieval and Routing Using the NEAT System
Gareth J. F. Jones | Tetsuya Sakai | Masahiro Kajiura | Kazuo Sumita
SIGIR '98: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, August 24-28 1998, Melbourne, Australia