NII Testbeds and Community for Information Access Research (2017)
Content
Proceedings of the 8th International Workshop on Evaluating Information Access co-located with the 13th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2017), Tokyo, Japan, December 5, 2017
Test Collections and Measures for Evaluating Customer-Helpdesk Dialogues
Zhaohao Zeng
|
Cheng Luo
|
Lifeng Shang
|
Hang Li
|
Tetsuya Sakai
An Interval-Like Scale Property for I. R. Evaluation Measures
Marco Ferrante
|
Nicola Ferro
|
Silvia Pontarollo
Evaluating Evaluation Measures with Worst-Case Confidence Interval Widths
Tetsuya Sakai
Automatic Evaluation of World History Essay Using Chronological and Geographical Measures
Kotaro Sakamoto
|
Hideyuki Shibuki
|
Madoka Ishioroshi
|
Akira Fujita
|
Yoshinobu Kano
|
Teruko Mitamura
|
Tatsunori Mori
|
Noriko Kando
Towards Automatic Evaluation of Multi-Turn Dialogues: A Task Design that Leverages Inherently Subjective Annotations
Tetsuya Sakai
The Effect of Inter-Assessor Disagreement on IR System Evaluation: A Case Study with Lancers and Students
Tetsuya Sakai
Unanimity-Aware Gain for Highly Subjective Assessments
Tetsuya Sakai