Assessors Agreement: A Case Study Across Assessor Type, Payment Levels, Query Variations and Relevance Dimensions.

João R. M. Palotti|Guido Zuccon|Johannes Bernhardt-Melischnig|Allan Hanbury|Lorraine Goeuriot


Anthology ID:DBLP:conf/clef/PalottiZBHG16
Volume:Experimental IR Meets Multilinguality, Multimodality, and Interaction - 7th International Conference of the CLEF Association, CLEF 2016, Évora, Portugal, September 5-8, 2016, Proceedings
Year:2016
Venue:Conference and Labs of the Evaluation Forum (CLEF)
Publisher:Springer
Pages:40-53
URL:https://doi.org/10.1007/978-3-319-44564-9_4
DOI:https://doi.org/10.1007/978-3-319-44564-9_4
DBLP:conf/clef/PalottiZBHG16
BibTeX:
@inproceedings{palotti-2016-assessors, author = {Jo\~{a}o R. M. Palotti and Guido Zuccon and Johannes Bernhardt-Melischnig and Allan Hanbury and Lorraine Goeuriot}, editor = {Norbert Fuhr and Paulo Quaresma and Teresa Gon\c{c}alves and Birger Larsen and Krisztian Balog and Craig Macdonald and Linda Cappellato and Nicola Ferro}, title = {{Assessors Agreement: A Case Study Across Assessor Type, Payment Levels, Query Variations and Relevance Dimensions}}, booktitle = {{Experimental IR Meets Multilinguality, Multimodality, and Interaction - 7th International Conference of the CLEF Association, CLEF 2016, \'{E}vora, Portugal, September 5-8, 2016, Proceedings}}, series = {Lecture Notes in Computer Science}, volume = {9822}, pages = {40--53}, publisher = {Springer}, year = {2016}, url = {https://doi.org/10.1007/978-3-319-44564-9_4}, doi = {https://doi.org/10.1007/978-3-319-44564-9_4} }