Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs.
Clemencia Siro|Mohammad Aliannejadi|Maarten de Rijke
| Anthology ID: | DBLP:conf/sigir/SiroAR24 |
|---|---|
| Volume: | Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2024, Washington DC, USA, July 14-18, 2024 |
| Year: | 2024 |
| Venue: | Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) |
| Publisher: | ACM |
| Pages: | 1952-1962 |
| URL: | https://doi.org/10.1145/3626772.3657712 |
| DOI: | https://doi.org/10.1145/3626772.3657712 |
| DBLP: | conf/sigir/SiroAR24 |
| BibTeX: |
@inproceedings{siro-2024-rethinking,
author = {Clemencia Siro and
Mohammad Aliannejadi and
Maarten de Rijke},
editor = {Grace Hui Yang and
Hongning Wang and
Sam Han and
Claudia Hauff and
Guido Zuccon and
Yi Zhang},
title = {{Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs}},
booktitle = {{Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2024, Washington DC, USA, July 14-18, 2024}},
pages = {1952--1962},
publisher = {ACM},
year = {2024},
url = {https://doi.org/10.1145/3626772.3657712},
doi = {https://doi.org/10.1145/3626772.3657712}
}