Robust reconstruction of causal graphical models based on conditional 2-point and 3-point information

Herve Isambert CNRS, Severine Affeldt Institut Curie
Proceedings of the 31st Conference on Uncertainty in Artificial Intelligence, PMLR R13:850-859, 2015.

Abstract

We report a novel network reconstruction method, which combines constraint-based and Bayesian frameworks to reliably reconstruct graphical models despite inherent sampling noise in finite observational datasets. The approach is based on an information theory result tracing back the existence of colliders in graphical models to negative conditional 3-point information between observed variables. This enables to confidently ascertain structural independencies in causal graphs, based on the ranking of their most likely contributing nodes with (significantly) positive conditional 3-point information. Starting from a complete undirected graph, dispensible edges are progressively pruned by iteratively ‘taking off’ the most likely positive conditional 3-point information from the 2-point (mutual) information between each pair of nodes. The resulting network skeleton is then partially directed by orienting and propagating edge directions, based on the sign and magnitude of the conditional 3-point information of unshielded triples. This ‘3off2’ network reconstruction approach is shown to outperform both constraint-based and Bayesian inference methods on a range of benchmark networks.

Cite this Paper

BibTeX
@InProceedings{pmlr-vR13-cnrs15a, title = {Robust reconstruction of causal graphical models based on conditional 2-point and 3-point information}, author = {CNRS, Herve Isambert and Curie, Severine Affeldt Institut}, booktitle = {Proceedings of the 31st Conference on Uncertainty in Artificial Intelligence}, pages = {850--859}, year = {2015}, editor = {Meila, Marina and Heskes, Tom}, volume = {R13}, series = {Proceedings of Machine Learning Research}, month = {12--16 Jul}, publisher = {PMLR}, pdf = {https://raw.githubusercontent.com/mlresearch/r13/main/assets/cnrs15a/cnrs15a.pdf}, url = {https://proceedings.mlr.press/r13/cnrs15a.html}, abstract = {We report a novel network reconstruction method, which combines constraint-based and Bayesian frameworks to reliably reconstruct graphical models despite inherent sampling noise in finite observational datasets. The approach is based on an information theory result tracing back the existence of colliders in graphical models to negative conditional 3-point information between observed variables. This enables to confidently ascertain structural independencies in causal graphs, based on the ranking of their most likely contributing nodes with (significantly) positive conditional 3-point information. Starting from a complete undirected graph, dispensible edges are progressively pruned by iteratively ‘taking off’ the most likely positive conditional 3-point information from the 2-point (mutual) information between each pair of nodes. The resulting network skeleton is then partially directed by orienting and propagating edge directions, based on the sign and magnitude of the conditional 3-point information of unshielded triples. This ‘3off2’ network reconstruction approach is shown to outperform both constraint-based and Bayesian inference methods on a range of benchmark networks.}, note = {Reissued by PMLR on 04 October 2026.} }
Endnote
%0 Conference Paper %T Robust reconstruction of causal graphical models based on conditional 2-point and 3-point information %A Herve Isambert CNRS %A Severine Affeldt Institut Curie %B Proceedings of the 31st Conference on Uncertainty in Artificial Intelligence %C Proceedings of Machine Learning Research %D 2015 %E Marina Meila %E Tom Heskes %F pmlr-vR13-cnrs15a %I PMLR %P 850--859 %U https://proceedings.mlr.press/r13/cnrs15a.html %V R13 %X We report a novel network reconstruction method, which combines constraint-based and Bayesian frameworks to reliably reconstruct graphical models despite inherent sampling noise in finite observational datasets. The approach is based on an information theory result tracing back the existence of colliders in graphical models to negative conditional 3-point information between observed variables. This enables to confidently ascertain structural independencies in causal graphs, based on the ranking of their most likely contributing nodes with (significantly) positive conditional 3-point information. Starting from a complete undirected graph, dispensible edges are progressively pruned by iteratively ‘taking off’ the most likely positive conditional 3-point information from the 2-point (mutual) information between each pair of nodes. The resulting network skeleton is then partially directed by orienting and propagating edge directions, based on the sign and magnitude of the conditional 3-point information of unshielded triples. This ‘3off2’ network reconstruction approach is shown to outperform both constraint-based and Bayesian inference methods on a range of benchmark networks. %Z Reissued by PMLR on 04 October 2026.
APA
CNRS, H.I. & Curie, S.A.I.. (2015). Robust reconstruction of causal graphical models based on conditional 2-point and 3-point information. Proceedings of the 31st Conference on Uncertainty in Artificial Intelligence, in Proceedings of Machine Learning Research R13:850-859 Available from https://proceedings.mlr.press/r13/cnrs15a.html. Reissued by PMLR on 04 October 2026.

Related Material