Naghmeh Farzi

2026

doi dblp
Supporting Humans in Evaluating AI Summaries of Legal Depositions.
Naghmeh Farzi|Laura Dietz|David D. Lewis
Proceedings of the 2026 Conference on Human Information Interaction and Retrieval, CHIIR 2026, Seattle, WA, USA, March 22-26, 2026
doi dblp
Too Many Questions: Deriving Concise and Effective Nugget Banks.
Yang Guan|Laura Dietz|Patrick Palmer|Dawn J. Lawrie|Naghmeh Farzi|Eugene Yang|Yang Guan|Laura Dietz|Dawn J. Lawrie|Patrick Palmer
Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2026, MelbourneVICAustralia, July 20-24, 2026
doi dblp
Learning to Rank with Multi-Criteria LLM-Judge Annotations.
Helene Hembrooke|Naghmeh Farzi|Laura Dietz|Geri Gay|Naghmeh Farzi|Helene Hembrooke|Laura Dietz|Geri Gay
Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2026, MelbourneVICAustralia, July 20-24, 2026
doi dblp
Auto-Judge: A Cross-Task Benchmark for Comparing LLM Judges for Citation-Grounded RAG Systems.
Naghmeh Farzi|Tim Hagen|Eugene Yang|Maik Fröbe|Ronak Pradeep|Hossein A. Rahmani|Xi Wang|Oleg Zendel|Martin Potthast|Laura Dietz
Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2026, MelbourneVICAustralia, July 20-24, 2026

2025

doi dblp
Criteria-Based LLM Relevance Judgments.
Naghmeh Farzi|Laura Dietz
Proceedings of the 2025 International ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval, ICTIR 2025, Padua, Italy, 18 July 2025
doi dblp
Does UMBRELA work on other LLMs?
Naghmeh Farzi|Asmaa Z. A. M. Alqadri|Laura Dietz
Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18, 2025

2024

doi dblp
Pencils Down! Automatic Rubric-based Evaluation of Retrieve/Generate Systems.
Naghmeh Farzi|Laura Dietz
Proceedings of the 2024 ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2024, Washington, DC, USA, 13 July 2024
dblp
TREMA-UNH at TREC: RAG Systems and RUBRIC-style Evaluation.
Naghmeh Farzi|Laura Dietz
Proceedings of the Thirty-Third Text REtrieval Conference, TREC 2024, Gaithersburg, MD, USA, November 18-22, 2024