Position: We Need A Unified Definition of Hallucination (It’s The World Model, Stupid!)

Emmy Liu, Varun Prashant Gangal, Chelsea Zou, Michael Yu, Xiaoqi Huang, Alex Chang, Zhuofu Tao, Karanpartap Singh, Sachin Kumar, Steven Y. Feng
Proceedings of the 43rd International Conference on Machine Learning, PMLR 306:171298-171314, 2026.

Abstract

Despite numerous attempts at mitigation since the inception of language models, hallucinations remain a persistent problem even in today’s frontier LLMs. Why is this? We review existing definitions of hallucination and fold them into a single, unified definition wherein prior definitions are subsumed. This position paper argues that hallucination can be unified by defining it as simply inaccurate (internal) world modeling, in a form where it is observable to the user. For example, stating a fact which contradicts a knowledge base OR producing a summary which contradicts the source. By varying the reference world model and conflict policy, our framework unifies prior definitions. We argue that this unified view is useful because it forces evaluations to clarify their assumed reference “world”, distinguishes true hallucinations from planning or reward errors, and provides a common language for comparison across benchmarks and discussion of mitigation strategies. Building on this definition, we also connect our framework to HalluWorld (Liu et al., 2026), a complementary benchmark that instantiates fully specified reference world models for stress-testing model hallucinations.

Cite this Paper


BibTeX
@InProceedings{pmlr-v306-liu26gu, title = {Position: We Need A Unified Definition of Hallucination ({I}t’s The World Model, Stupid!)}, author = {Liu, Emmy and Gangal, Varun Prashant and Zou, Chelsea and Yu, Michael and Huang, Xiaoqi and Chang, Alex and Tao, Zhuofu and Singh, Karanpartap and Kumar, Sachin and Feng, Steven Y.}, booktitle = {Proceedings of the 43rd International Conference on Machine Learning}, pages = {171298--171314}, year = {2026}, editor = {Zhang, Tong and Dudik, Miroslav and Jaggi, Martin and Agarwal, Alekh and Li, Sharon and Schuurmans, Dale and Zhu, Jerry and Berkenkamp, Felix and Dong, Hanze and Bietti, Alberto}, volume = {306}, series = {Proceedings of Machine Learning Research}, month = {06--11 Jul}, publisher = {PMLR}, pdf = {https://raw.githubusercontent.com/mlresearch/v306/main/assets/liu26gu/liu26gu.pdf}, url = {https://proceedings.mlr.press/v306/liu26gu.html}, abstract = {Despite numerous attempts at mitigation since the inception of language models, hallucinations remain a persistent problem even in today’s frontier LLMs. Why is this? We review existing definitions of hallucination and fold them into a single, unified definition wherein prior definitions are subsumed. This position paper argues that hallucination can be unified by defining it as simply inaccurate (internal) world modeling, in a form where it is observable to the user. For example, stating a fact which contradicts a knowledge base OR producing a summary which contradicts the source. By varying the reference world model and conflict policy, our framework unifies prior definitions. We argue that this unified view is useful because it forces evaluations to clarify their assumed reference “world”, distinguishes true hallucinations from planning or reward errors, and provides a common language for comparison across benchmarks and discussion of mitigation strategies. Building on this definition, we also connect our framework to HalluWorld (Liu et al., 2026), a complementary benchmark that instantiates fully specified reference world models for stress-testing model hallucinations.} }
Endnote
%0 Conference Paper %T Position: We Need A Unified Definition of Hallucination (It’s The World Model, Stupid!) %A Emmy Liu %A Varun Prashant Gangal %A Chelsea Zou %A Michael Yu %A Xiaoqi Huang %A Alex Chang %A Zhuofu Tao %A Karanpartap Singh %A Sachin Kumar %A Steven Y. Feng %B Proceedings of the 43rd International Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2026 %E Tong Zhang %E Miroslav Dudik %E Martin Jaggi %E Alekh Agarwal %E Sharon Li %E Dale Schuurmans %E Jerry Zhu %E Felix Berkenkamp %E Hanze Dong %E Alberto Bietti %F pmlr-v306-liu26gu %I PMLR %P 171298--171314 %U https://proceedings.mlr.press/v306/liu26gu.html %V 306 %X Despite numerous attempts at mitigation since the inception of language models, hallucinations remain a persistent problem even in today’s frontier LLMs. Why is this? We review existing definitions of hallucination and fold them into a single, unified definition wherein prior definitions are subsumed. This position paper argues that hallucination can be unified by defining it as simply inaccurate (internal) world modeling, in a form where it is observable to the user. For example, stating a fact which contradicts a knowledge base OR producing a summary which contradicts the source. By varying the reference world model and conflict policy, our framework unifies prior definitions. We argue that this unified view is useful because it forces evaluations to clarify their assumed reference “world”, distinguishes true hallucinations from planning or reward errors, and provides a common language for comparison across benchmarks and discussion of mitigation strategies. Building on this definition, we also connect our framework to HalluWorld (Liu et al., 2026), a complementary benchmark that instantiates fully specified reference world models for stress-testing model hallucinations.
APA
Liu, E., Gangal, V.P., Zou, C., Yu, M., Huang, X., Chang, A., Tao, Z., Singh, K., Kumar, S. & Feng, S.Y.. (2026). Position: We Need A Unified Definition of Hallucination (It’s The World Model, Stupid!). Proceedings of the 43rd International Conference on Machine Learning, in Proceedings of Machine Learning Research 306:171298-171314 Available from https://proceedings.mlr.press/v306/liu26gu.html.

Related Material