Main » NTCIR »


NII Testbeds and Community for Information Access Research (2017)


Content

    up

    Proceedings of the 8th International Workshop on Evaluating Information Access co-located with the 13th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2017), Tokyo, Japan, December 5, 2017

    dblp
    Proceedings of the 8th International Workshop on Evaluating Information Access co-located with the 13th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2017), Tokyo, Japan, December 5, 2017

    pdf dblp
    Test Collections and Measures for Evaluating Customer-Helpdesk Dialogues
    Zhaohao Zeng | Cheng Luo | Lifeng Shang | Hang Li | Tetsuya Sakai

    pdf dblp
    An Interval-Like Scale Property for I. R. Evaluation Measures
    Marco Ferrante | Nicola Ferro | Silvia Pontarollo

    pdf dblp
    Evaluating Evaluation Measures with Worst-Case Confidence Interval Widths
    Tetsuya Sakai

    pdf dblp
    Automatic Evaluation of World History Essay Using Chronological and Geographical Measures
    Kotaro Sakamoto | Hideyuki Shibuki | Madoka Ishioroshi | Akira Fujita | Yoshinobu Kano | Teruko Mitamura | Tatsunori Mori | Noriko Kando

    pdf dblp
    Towards Automatic Evaluation of Multi-Turn Dialogues: A Task Design that Leverages Inherently Subjective Annotations
    Tetsuya Sakai

    pdf dblp
    The Effect of Inter-Assessor Disagreement on IR System Evaluation: A Case Study with Lancers and Students
    Tetsuya Sakai

    pdf dblp
    Unanimity-Aware Gain for Highly Subjective Assessments
    Tetsuya Sakai