Position: Reliable AI Needs to Externalize Implicit Knowledge: A Human–AI Collaboration Perspective

Hengyu Liu, Tianyi Li, Zhihong Cui, Yushuai Li, Zhangkai Wu, Torben Bach Pedersen, Kristian Torp, Christian S. Jensen
Proceedings of the 43rd International Conference on Machine Learning, PMLR 306:171330-171343, 2026.

Abstract

This position paper argues that reliable AI requires infrastructure for human validation of implicit knowledge. AI learns from both explicit knowledge (papers, documentation, structured databases) and implicit knowledge (reasoning patterns, debugging processes, intermediate steps). Implicit knowledge remains unexternalized because documentation cost exceeds perceived value—yet AI learns from it indiscriminately, acquiring both beneficial patterns and harmful biases. Current reliability methods can only verify explicit knowledge against sources, creating a fundamental gap: the most valuable AI capabilities (reasoning, judgment, intuition) are precisely those we cannot verify. We propose Knowledge Objects (KOs)—structured artifacts that externalize implicit knowledge into forms humans can inspect, verify, and endorse. KOs transform verification economics: what was previously too costly to verify becomes feasible, enabling accumulated human validation to improve reliability over time.

Cite this Paper


BibTeX
@InProceedings{pmlr-v306-liu26gw, title = {Position: Reliable {AI} Needs to Externalize Implicit Knowledge: A Human–{AI} Collaboration Perspective}, author = {Liu, Hengyu and Li, Tianyi and Cui, Zhihong and Li, Yushuai and Wu, Zhangkai and Pedersen, Torben Bach and Torp, Kristian and Jensen, Christian S.}, booktitle = {Proceedings of the 43rd International Conference on Machine Learning}, pages = {171330--171343}, year = {2026}, editor = {Zhang, Tong and Dudik, Miroslav and Jaggi, Martin and Agarwal, Alekh and Li, Sharon and Schuurmans, Dale and Zhu, Jerry and Berkenkamp, Felix and Dong, Hanze and Bietti, Alberto}, volume = {306}, series = {Proceedings of Machine Learning Research}, month = {06--11 Jul}, publisher = {PMLR}, pdf = {https://raw.githubusercontent.com/mlresearch/v306/main/assets/liu26gw/liu26gw.pdf}, url = {https://proceedings.mlr.press/v306/liu26gw.html}, abstract = {This position paper argues that reliable AI requires infrastructure for human validation of implicit knowledge. AI learns from both explicit knowledge (papers, documentation, structured databases) and implicit knowledge (reasoning patterns, debugging processes, intermediate steps). Implicit knowledge remains unexternalized because documentation cost exceeds perceived value—yet AI learns from it indiscriminately, acquiring both beneficial patterns and harmful biases. Current reliability methods can only verify explicit knowledge against sources, creating a fundamental gap: the most valuable AI capabilities (reasoning, judgment, intuition) are precisely those we cannot verify. We propose Knowledge Objects (KOs)—structured artifacts that externalize implicit knowledge into forms humans can inspect, verify, and endorse. KOs transform verification economics: what was previously too costly to verify becomes feasible, enabling accumulated human validation to improve reliability over time.} }
Endnote
%0 Conference Paper %T Position: Reliable AI Needs to Externalize Implicit Knowledge: A Human–AI Collaboration Perspective %A Hengyu Liu %A Tianyi Li %A Zhihong Cui %A Yushuai Li %A Zhangkai Wu %A Torben Bach Pedersen %A Kristian Torp %A Christian S. Jensen %B Proceedings of the 43rd International Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2026 %E Tong Zhang %E Miroslav Dudik %E Martin Jaggi %E Alekh Agarwal %E Sharon Li %E Dale Schuurmans %E Jerry Zhu %E Felix Berkenkamp %E Hanze Dong %E Alberto Bietti %F pmlr-v306-liu26gw %I PMLR %P 171330--171343 %U https://proceedings.mlr.press/v306/liu26gw.html %V 306 %X This position paper argues that reliable AI requires infrastructure for human validation of implicit knowledge. AI learns from both explicit knowledge (papers, documentation, structured databases) and implicit knowledge (reasoning patterns, debugging processes, intermediate steps). Implicit knowledge remains unexternalized because documentation cost exceeds perceived value—yet AI learns from it indiscriminately, acquiring both beneficial patterns and harmful biases. Current reliability methods can only verify explicit knowledge against sources, creating a fundamental gap: the most valuable AI capabilities (reasoning, judgment, intuition) are precisely those we cannot verify. We propose Knowledge Objects (KOs)—structured artifacts that externalize implicit knowledge into forms humans can inspect, verify, and endorse. KOs transform verification economics: what was previously too costly to verify becomes feasible, enabling accumulated human validation to improve reliability over time.
APA
Liu, H., Li, T., Cui, Z., Li, Y., Wu, Z., Pedersen, T.B., Torp, K. & Jensen, C.S.. (2026). Position: Reliable AI Needs to Externalize Implicit Knowledge: A Human–AI Collaboration Perspective. Proceedings of the 43rd International Conference on Machine Learning, in Proceedings of Machine Learning Research 306:171330-171343 Available from https://proceedings.mlr.press/v306/liu26gw.html.

Related Material