Position: Stop Automating Peer Review Without Rigorous Evaluation

Joachim Baumann, Jiaxin Pei, Sanmi Koyejo, Dirk Hovy
Proceedings of the 43rd International Conference on Machine Learning, PMLR 306:169349-169380, 2026.

Abstract

Large language models offer a tempting solution to address the peer review crisis. This position paper argues that today’s AI systems should not be used to produce paper reviews. We ground this position in an empirical comparison of human- versus AI-generated ICLR 2026 reviews and an evaluation of the effect of automated paper rewriting on different AI reviewers. We identify two critical issues: 1) AI reviewers exhibit a hivemind effect of excessive agreement within and across papers that reduces perspective diversity. 2) AI review scores are trivially gameable through paper laundering: prompting an LLM to rewrite a paper could significantly increase the scores from AI reviewers, demonstrating that LLM reviewers are easy to game through stylistic changes rather than scientific results. However, non-gameability and review diversity are necessary but not sufficient conditions for automation. We argue that addressing the peer review crisis requires a science of peer review automation – not general-purpose LLMs deployed without rigorous evaluation.

Cite this Paper


BibTeX
@InProceedings{pmlr-v306-baumann26a, title = {Position: Stop Automating Peer Review Without Rigorous Evaluation}, author = {Baumann, Joachim and Pei, Jiaxin and Koyejo, Sanmi and Hovy, Dirk}, booktitle = {Proceedings of the 43rd International Conference on Machine Learning}, pages = {169349--169380}, year = {2026}, editor = {Zhang, Tong and Dudik, Miroslav and Jaggi, Martin and Agarwal, Alekh and Li, Sharon and Schuurmans, Dale and Zhu, Jerry and Berkenkamp, Felix and Dong, Hanze and Bietti, Alberto}, volume = {306}, series = {Proceedings of Machine Learning Research}, month = {06--11 Jul}, publisher = {PMLR}, pdf = {https://raw.githubusercontent.com/mlresearch/v306/main/assets/baumann26a/baumann26a.pdf}, url = {https://proceedings.mlr.press/v306/baumann26a.html}, abstract = {Large language models offer a tempting solution to address the peer review crisis. This position paper argues that today’s AI systems should not be used to produce paper reviews. We ground this position in an empirical comparison of human- versus AI-generated ICLR 2026 reviews and an evaluation of the effect of automated paper rewriting on different AI reviewers. We identify two critical issues: 1) AI reviewers exhibit a hivemind effect of excessive agreement within and across papers that reduces perspective diversity. 2) AI review scores are trivially gameable through paper laundering: prompting an LLM to rewrite a paper could significantly increase the scores from AI reviewers, demonstrating that LLM reviewers are easy to game through stylistic changes rather than scientific results. However, non-gameability and review diversity are necessary but not sufficient conditions for automation. We argue that addressing the peer review crisis requires a science of peer review automation – not general-purpose LLMs deployed without rigorous evaluation.} }
Endnote
%0 Conference Paper %T Position: Stop Automating Peer Review Without Rigorous Evaluation %A Joachim Baumann %A Jiaxin Pei %A Sanmi Koyejo %A Dirk Hovy %B Proceedings of the 43rd International Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2026 %E Tong Zhang %E Miroslav Dudik %E Martin Jaggi %E Alekh Agarwal %E Sharon Li %E Dale Schuurmans %E Jerry Zhu %E Felix Berkenkamp %E Hanze Dong %E Alberto Bietti %F pmlr-v306-baumann26a %I PMLR %P 169349--169380 %U https://proceedings.mlr.press/v306/baumann26a.html %V 306 %X Large language models offer a tempting solution to address the peer review crisis. This position paper argues that today’s AI systems should not be used to produce paper reviews. We ground this position in an empirical comparison of human- versus AI-generated ICLR 2026 reviews and an evaluation of the effect of automated paper rewriting on different AI reviewers. We identify two critical issues: 1) AI reviewers exhibit a hivemind effect of excessive agreement within and across papers that reduces perspective diversity. 2) AI review scores are trivially gameable through paper laundering: prompting an LLM to rewrite a paper could significantly increase the scores from AI reviewers, demonstrating that LLM reviewers are easy to game through stylistic changes rather than scientific results. However, non-gameability and review diversity are necessary but not sufficient conditions for automation. We argue that addressing the peer review crisis requires a science of peer review automation – not general-purpose LLMs deployed without rigorous evaluation.
APA
Baumann, J., Pei, J., Koyejo, S. & Hovy, D.. (2026). Position: Stop Automating Peer Review Without Rigorous Evaluation. Proceedings of the 43rd International Conference on Machine Learning, in Proceedings of Machine Learning Research 306:169349-169380 Available from https://proceedings.mlr.press/v306/baumann26a.html.

Related Material