PostTrainBench: Can LLM Agents Automate LLM Post-Training?

Ben Rank, Hardik Bhatnagar, Ameya Prabhu, Shira Eisenberg, Karina Nguyen, Matthias Bethge, Maksym Andriushchenko
Proceedings of the 43rd International Conference on Machine Learning, PMLR 306:103808-103823, 2026.

Abstract

AI agents have become surprisingly proficient at software engineering over the past year, largely due to improvements in reasoning capabilities. This raises a deeper question: can these systems extend their capabilities to automate AI research itself? We introduce PostTrainBench to benchmark how well LLM agents can perform post-training autonomously under bounded compute constraints (10 hours on one H100 GPU). We ask frontier agents (e.g., Claude Code with Opus 4.6) to optimize the performance of a base LLM on a particular benchmark (e.g., Qwen3-4B on AIME). Importantly, we do not provide any predefined strategies to the agents and instead give them full autonomy to find necessary information on the web, run experiments, and curate data. We find that frontier agents make substantial progress but generally lag behind official instruction-tuned LLMs: 27.9% for the best agent vs. 51.1% for official instruction-tuned models. However, agents can exceed instruction-tuned models in targeted scenarios: GPT-5.1 Codex Max achieves 89% on BFCL with Gemma-3-4B vs. 67% for the official model. We also observe failure modes: agents engage in reward hacking by training on the test set, downloading existing instruction-tuned checkpoints, or using found API keys to generate synthetic data without authorization. Overall, we hope PostTrainBench will be useful for tracking progress in AI R&D automation and for studying the risks that come with it.

Cite this Paper


BibTeX
@InProceedings{pmlr-v306-rank26a, title = {{P}ost{T}rain{B}ench: Can {LLM} Agents Automate {LLM} Post-Training?}, author = {Rank, Ben and Bhatnagar, Hardik and Prabhu, Ameya and Eisenberg, Shira and Nguyen, Karina and Bethge, Matthias and Andriushchenko, Maksym}, booktitle = {Proceedings of the 43rd International Conference on Machine Learning}, pages = {103808--103823}, year = {2026}, editor = {Zhang, Tong and Dudik, Miroslav and Jaggi, Martin and Agarwal, Alekh and Li, Sharon and Schuurmans, Dale and Zhu, Jerry and Berkenkamp, Felix and Dong, Hanze and Bietti, Alberto}, volume = {306}, series = {Proceedings of Machine Learning Research}, month = {06--11 Jul}, publisher = {PMLR}, pdf = {https://raw.githubusercontent.com/mlresearch/v306/main/assets/rank26a/rank26a.pdf}, url = {https://proceedings.mlr.press/v306/rank26a.html}, abstract = {AI agents have become surprisingly proficient at software engineering over the past year, largely due to improvements in reasoning capabilities. This raises a deeper question: can these systems extend their capabilities to automate AI research itself? We introduce PostTrainBench to benchmark how well LLM agents can perform post-training autonomously under bounded compute constraints (10 hours on one H100 GPU). We ask frontier agents (e.g., Claude Code with Opus 4.6) to optimize the performance of a base LLM on a particular benchmark (e.g., Qwen3-4B on AIME). Importantly, we do not provide any predefined strategies to the agents and instead give them full autonomy to find necessary information on the web, run experiments, and curate data. We find that frontier agents make substantial progress but generally lag behind official instruction-tuned LLMs: 27.9% for the best agent vs. 51.1% for official instruction-tuned models. However, agents can exceed instruction-tuned models in targeted scenarios: GPT-5.1 Codex Max achieves 89% on BFCL with Gemma-3-4B vs. 67% for the official model. We also observe failure modes: agents engage in reward hacking by training on the test set, downloading existing instruction-tuned checkpoints, or using found API keys to generate synthetic data without authorization. Overall, we hope PostTrainBench will be useful for tracking progress in AI R&D automation and for studying the risks that come with it.} }
Endnote
%0 Conference Paper %T PostTrainBench: Can LLM Agents Automate LLM Post-Training? %A Ben Rank %A Hardik Bhatnagar %A Ameya Prabhu %A Shira Eisenberg %A Karina Nguyen %A Matthias Bethge %A Maksym Andriushchenko %B Proceedings of the 43rd International Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2026 %E Tong Zhang %E Miroslav Dudik %E Martin Jaggi %E Alekh Agarwal %E Sharon Li %E Dale Schuurmans %E Jerry Zhu %E Felix Berkenkamp %E Hanze Dong %E Alberto Bietti %F pmlr-v306-rank26a %I PMLR %P 103808--103823 %U https://proceedings.mlr.press/v306/rank26a.html %V 306 %X AI agents have become surprisingly proficient at software engineering over the past year, largely due to improvements in reasoning capabilities. This raises a deeper question: can these systems extend their capabilities to automate AI research itself? We introduce PostTrainBench to benchmark how well LLM agents can perform post-training autonomously under bounded compute constraints (10 hours on one H100 GPU). We ask frontier agents (e.g., Claude Code with Opus 4.6) to optimize the performance of a base LLM on a particular benchmark (e.g., Qwen3-4B on AIME). Importantly, we do not provide any predefined strategies to the agents and instead give them full autonomy to find necessary information on the web, run experiments, and curate data. We find that frontier agents make substantial progress but generally lag behind official instruction-tuned LLMs: 27.9% for the best agent vs. 51.1% for official instruction-tuned models. However, agents can exceed instruction-tuned models in targeted scenarios: GPT-5.1 Codex Max achieves 89% on BFCL with Gemma-3-4B vs. 67% for the official model. We also observe failure modes: agents engage in reward hacking by training on the test set, downloading existing instruction-tuned checkpoints, or using found API keys to generate synthetic data without authorization. Overall, we hope PostTrainBench will be useful for tracking progress in AI R&D automation and for studying the risks that come with it.
APA
Rank, B., Bhatnagar, H., Prabhu, A., Eisenberg, S., Nguyen, K., Bethge, M. & Andriushchenko, M.. (2026). PostTrainBench: Can LLM Agents Automate LLM Post-Training?. Proceedings of the 43rd International Conference on Machine Learning, in Proceedings of Machine Learning Research 306:103808-103823 Available from https://proceedings.mlr.press/v306/rank26a.html.

Related Material