Position: Modular Safety Guardrails Are Necessary for Foundation-Model-Enabled Robots in the Real World

Joonkyung Kim, Wenxi Chen, Davood Soleymanzadeh, Yi Ding, Xiangbo Gao, Zhengzhong Tu, Ruqi Zhang, Fan Fei, Sushant Veer, Yiwei Lyu, Minghui Zheng, Yan Gu
Proceedings of the 43rd International Conference on Machine Learning, PMLR 306:171011-171025, 2026.

Abstract

The integration of foundation models (FMs) into robotics has accelerated real-world deployment, while introducing new safety challenges arising from open-ended semantic reasoning and embodied physical action. These challenges require safety notions beyond physical constraint satisfaction. In this position paper, we characterize FM-enabled robot safety along three dimensions: action safety (physical feasibility and constraint compliance), decision safety (semantic and contextual appropriateness), and human-centered safety (conformance to human intent, norms, and expectations). We argue that existing approaches, including static verification, monolithic controllers, and end-to-end learned policies, are insufficient in settings where tasks, environments, and human expectations are open-ended, long-tailed, and subject to adaptation over time. To address this gap, we propose modular safety guardrails, consisting of monitoring (evaluation) and intervention layers, as an architectural foundation for comprehensive safety across the autonomy stack. Beyond modularity, we highlight possible cross-layer co-design opportunities through representation alignment and conservatism allocation to enable faster, less conservative, and more effective safety enforcement. We call on the community to explore richer guardrail modules and principled co-design strategies to advance safe real-world physical AI deployment.

Cite this Paper


BibTeX
@InProceedings{pmlr-v306-kim26cb, title = {Position: Modular Safety Guardrails Are Necessary for Foundation-Model-Enabled Robots in the Real World}, author = {Kim, Joonkyung and Chen, Wenxi and Soleymanzadeh, Davood and Ding, Yi and Gao, Xiangbo and Tu, Zhengzhong and Zhang, Ruqi and Fei, Fan and Veer, Sushant and Lyu, Yiwei and Zheng, Minghui and Gu, Yan}, booktitle = {Proceedings of the 43rd International Conference on Machine Learning}, pages = {171011--171025}, year = {2026}, editor = {Zhang, Tong and Dudik, Miroslav and Jaggi, Martin and Agarwal, Alekh and Li, Sharon and Schuurmans, Dale and Zhu, Jerry and Berkenkamp, Felix and Dong, Hanze and Bietti, Alberto}, volume = {306}, series = {Proceedings of Machine Learning Research}, month = {06--11 Jul}, publisher = {PMLR}, pdf = {https://raw.githubusercontent.com/mlresearch/v306/main/assets/kim26cb/kim26cb.pdf}, url = {https://proceedings.mlr.press/v306/kim26cb.html}, abstract = {The integration of foundation models (FMs) into robotics has accelerated real-world deployment, while introducing new safety challenges arising from open-ended semantic reasoning and embodied physical action. These challenges require safety notions beyond physical constraint satisfaction. In this position paper, we characterize FM-enabled robot safety along three dimensions: action safety (physical feasibility and constraint compliance), decision safety (semantic and contextual appropriateness), and human-centered safety (conformance to human intent, norms, and expectations). We argue that existing approaches, including static verification, monolithic controllers, and end-to-end learned policies, are insufficient in settings where tasks, environments, and human expectations are open-ended, long-tailed, and subject to adaptation over time. To address this gap, we propose modular safety guardrails, consisting of monitoring (evaluation) and intervention layers, as an architectural foundation for comprehensive safety across the autonomy stack. Beyond modularity, we highlight possible cross-layer co-design opportunities through representation alignment and conservatism allocation to enable faster, less conservative, and more effective safety enforcement. We call on the community to explore richer guardrail modules and principled co-design strategies to advance safe real-world physical AI deployment.} }
Endnote
%0 Conference Paper %T Position: Modular Safety Guardrails Are Necessary for Foundation-Model-Enabled Robots in the Real World %A Joonkyung Kim %A Wenxi Chen %A Davood Soleymanzadeh %A Yi Ding %A Xiangbo Gao %A Zhengzhong Tu %A Ruqi Zhang %A Fan Fei %A Sushant Veer %A Yiwei Lyu %A Minghui Zheng %A Yan Gu %B Proceedings of the 43rd International Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2026 %E Tong Zhang %E Miroslav Dudik %E Martin Jaggi %E Alekh Agarwal %E Sharon Li %E Dale Schuurmans %E Jerry Zhu %E Felix Berkenkamp %E Hanze Dong %E Alberto Bietti %F pmlr-v306-kim26cb %I PMLR %P 171011--171025 %U https://proceedings.mlr.press/v306/kim26cb.html %V 306 %X The integration of foundation models (FMs) into robotics has accelerated real-world deployment, while introducing new safety challenges arising from open-ended semantic reasoning and embodied physical action. These challenges require safety notions beyond physical constraint satisfaction. In this position paper, we characterize FM-enabled robot safety along three dimensions: action safety (physical feasibility and constraint compliance), decision safety (semantic and contextual appropriateness), and human-centered safety (conformance to human intent, norms, and expectations). We argue that existing approaches, including static verification, monolithic controllers, and end-to-end learned policies, are insufficient in settings where tasks, environments, and human expectations are open-ended, long-tailed, and subject to adaptation over time. To address this gap, we propose modular safety guardrails, consisting of monitoring (evaluation) and intervention layers, as an architectural foundation for comprehensive safety across the autonomy stack. Beyond modularity, we highlight possible cross-layer co-design opportunities through representation alignment and conservatism allocation to enable faster, less conservative, and more effective safety enforcement. We call on the community to explore richer guardrail modules and principled co-design strategies to advance safe real-world physical AI deployment.
APA
Kim, J., Chen, W., Soleymanzadeh, D., Ding, Y., Gao, X., Tu, Z., Zhang, R., Fei, F., Veer, S., Lyu, Y., Zheng, M. & Gu, Y.. (2026). Position: Modular Safety Guardrails Are Necessary for Foundation-Model-Enabled Robots in the Real World. Proceedings of the 43rd International Conference on Machine Learning, in Proceedings of Machine Learning Research 306:171011-171025 Available from https://proceedings.mlr.press/v306/kim26cb.html.

Related Material