Assessing Support for the TREC 2024 RAG Track: A Large-Scale Comparative Study of LLM and Human Evaluations.
Nandan Thakur|Ronak Pradeep|Shivani Upadhyay|Daniel Campos|Nick Craswell|Ian Soboroff|Hoa Trang Dang|Jimmy Lin
| Anthology ID: | DBLP:conf/sigir/ThakurPUCCSDL25 |
|---|---|
| Volume: | Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025 |
| Year: | 2025 |
| Venue: | Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) |
| Publisher: | ACM |
| Pages: | 2759-2763 |
| URL: | https://doi.org/10.1145/3726302.3730165 |
| DOI: | https://doi.org/10.1145/3726302.3730165 |
| DBLP: | conf/sigir/ThakurPUCCSDL25 |
| BibTeX: |
@inproceedings{thakur-2025-assessing,
author = {Nandan Thakur and
Ronak Pradeep and
Shivani Upadhyay and
Daniel Campos and
Nick Craswell and
Ian Soboroff and
Hoa Trang Dang and
Jimmy Lin},
editor = {Nicola Ferro and
Maria Maistro and
Gabriella Pasi and
Omar Alonso and
Andrew Trotman and
Suzan Verberne},
title = {{Assessing Support for the TREC 2024 RAG Track: A Large-Scale Comparative Study of LLM and Human Evaluations}},
booktitle = {{Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025}},
pages = {2759--2763},
publisher = {ACM},
year = {2025},
url = {https://doi.org/10.1145/3726302.3730165},
doi = {https://doi.org/10.1145/3726302.3730165}
}