Proceedings of the 8th International Workshop on Evaluating Information Access co-located with the 13th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2017), Tokyo, Japan, December 5, 2017
Nicola Ferro, Ian Soboroff (Editors)
- Anthology ID:
- 2017.ntcir_workshop-2017evia
- Year:
- 2017
- Venue:
- ntcir_workshop
- Publisher:
- CEUR-WS.org
- URL:
- https://ceur-ws.org/Vol-2008
- DBLP:
- conf/ntcir/2017evia
Test Collections and Measures for Evaluating Customer-Helpdesk Dialogues
Zhaohao Zeng
|
Cheng Luo
|
Lifeng Shang
|
Hang Li
|
Tetsuya Sakai
An Interval-Like Scale Property for I. R. Evaluation Measures
Marco Ferrante
|
Nicola Ferro
|
Silvia Pontarollo
Evaluating Evaluation Measures with Worst-Case Confidence Interval Widths
Tetsuya Sakai
Automatic Evaluation of World History Essay Using Chronological and Geographical Measures
Kotaro Sakamoto
|
Hideyuki Shibuki
|
Madoka Ishioroshi
|
Akira Fujita
|
Yoshinobu Kano
|
Teruko Mitamura
|
Tatsunori Mori
|
Noriko Kando
Towards Automatic Evaluation of Multi-Turn Dialogues: A Task Design that Leverages Inherently Subjective Annotations
Tetsuya Sakai
The Effect of Inter-Assessor Disagreement on IR System Evaluation: A Case Study with Lancers and Students
Tetsuya Sakai
Unanimity-Aware Gain for Highly Subjective Assessments
Tetsuya Sakai