Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons.

Renjun Hu|Yi Cheng|Libin Meng|Jiaxin Xia|Yi Zong|Xing Shi|Wei Lin


Anthology ID:DBLP:conf/www/HuCMXZSL25
Volume:Companion Proceedings of the ACM on Web Conference 2025, WWW 2025, Sydney, NSW, Australia, 28 April 2025 - 2 May 2025
Year:2025
Venue:The Web Conference (WWW)
Publisher:ACM
Pages:228-237
URL:https://doi.org/10.1145/3701716.3715265
DOI:https://doi.org/10.1145/3701716.3715265
DBLP:conf/www/HuCMXZSL25
BibTeX:
@inproceedings{hu-2025-training, author = {Renjun Hu and Yi Cheng and Libin Meng and Jiaxin Xia and Yi Zong and Xing Shi and Wei Lin}, editor = {Guodong Long and Michale Blumestein and Yi Chang and Liane Lewin-Eytan and Zi Huang and Elad Yom-Tov}, title = {{Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons}}, booktitle = {{Companion Proceedings of the ACM on Web Conference 2025, WWW 2025, Sydney, NSW, Australia, 28 April 2025 - 2 May 2025}}, pages = {228--237}, publisher = {ACM}, year = {2025}, url = {https://doi.org/10.1145/3701716.3715265}, doi = {https://doi.org/10.1145/3701716.3715265} }