Inference of Cause and Effect with Unsupervised Inverse Regression

Eleni Sgouritsa, Dominik Janzing, Philipp Hennig, Bernhard Schölkopf
; Proceedings of the Eighteenth International Conference on Artificial Intelligence and Statistics, PMLR 38:847-855, 2015.

Abstract

We address the problem of causal discovery in the two-variable case given a sample from their joint distribution. The proposed method is based on a known assumption that, if X -> Y (X causes Y), the marginal distribution of the cause, P(X), contains no information about the conditional distribution P(Y|X). Consequently, estimating P(Y|X) from P(X) should not be possible. However, estimating P(X|Y) based on P(Y) may be possible. This paper employs this asymmetry to propose CURE, a causal discovery method which decides upon the causal direction by comparing the accuracy of the estimations of P(Y|X) and P(X|Y). To this end, we propose a method for estimating a conditional from samples of the corresponding marginal, which we call unsupervised inverse GP regression. We evaluate CURE on synthetic and real data. On the latter, our method outperforms existing causal inference methods.

Cite this Paper


BibTeX
@InProceedings{pmlr-v38-sgouritsa15, title = {{Inference of Cause and Effect with Unsupervised Inverse Regression}}, author = {Eleni Sgouritsa and Dominik Janzing and Philipp Hennig and Bernhard Schölkopf}, booktitle = {Proceedings of the Eighteenth International Conference on Artificial Intelligence and Statistics}, pages = {847--855}, year = {2015}, editor = {Guy Lebanon and S. V. N. Vishwanathan}, volume = {38}, series = {Proceedings of Machine Learning Research}, address = {San Diego, California, USA}, month = {09--12 May}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v38/sgouritsa15.pdf}, url = {http://proceedings.mlr.press/v38/sgouritsa15.html}, abstract = {We address the problem of causal discovery in the two-variable case given a sample from their joint distribution. The proposed method is based on a known assumption that, if X -> Y (X causes Y), the marginal distribution of the cause, P(X), contains no information about the conditional distribution P(Y|X). Consequently, estimating P(Y|X) from P(X) should not be possible. However, estimating P(X|Y) based on P(Y) may be possible. This paper employs this asymmetry to propose CURE, a causal discovery method which decides upon the causal direction by comparing the accuracy of the estimations of P(Y|X) and P(X|Y). To this end, we propose a method for estimating a conditional from samples of the corresponding marginal, which we call unsupervised inverse GP regression. We evaluate CURE on synthetic and real data. On the latter, our method outperforms existing causal inference methods.} }
Endnote
%0 Conference Paper %T Inference of Cause and Effect with Unsupervised Inverse Regression %A Eleni Sgouritsa %A Dominik Janzing %A Philipp Hennig %A Bernhard Schölkopf %B Proceedings of the Eighteenth International Conference on Artificial Intelligence and Statistics %C Proceedings of Machine Learning Research %D 2015 %E Guy Lebanon %E S. V. N. Vishwanathan %F pmlr-v38-sgouritsa15 %I PMLR %J Proceedings of Machine Learning Research %P 847--855 %U http://proceedings.mlr.press %V 38 %W PMLR %X We address the problem of causal discovery in the two-variable case given a sample from their joint distribution. The proposed method is based on a known assumption that, if X -> Y (X causes Y), the marginal distribution of the cause, P(X), contains no information about the conditional distribution P(Y|X). Consequently, estimating P(Y|X) from P(X) should not be possible. However, estimating P(X|Y) based on P(Y) may be possible. This paper employs this asymmetry to propose CURE, a causal discovery method which decides upon the causal direction by comparing the accuracy of the estimations of P(Y|X) and P(X|Y). To this end, we propose a method for estimating a conditional from samples of the corresponding marginal, which we call unsupervised inverse GP regression. We evaluate CURE on synthetic and real data. On the latter, our method outperforms existing causal inference methods.
RIS
TY - CPAPER TI - Inference of Cause and Effect with Unsupervised Inverse Regression AU - Eleni Sgouritsa AU - Dominik Janzing AU - Philipp Hennig AU - Bernhard Schölkopf BT - Proceedings of the Eighteenth International Conference on Artificial Intelligence and Statistics PY - 2015/02/21 DA - 2015/02/21 ED - Guy Lebanon ED - S. V. N. Vishwanathan ID - pmlr-v38-sgouritsa15 PB - PMLR SP - 847 DP - PMLR EP - 855 L1 - http://proceedings.mlr.press/v38/sgouritsa15.pdf UR - http://proceedings.mlr.press/v38/sgouritsa15.html AB - We address the problem of causal discovery in the two-variable case given a sample from their joint distribution. The proposed method is based on a known assumption that, if X -> Y (X causes Y), the marginal distribution of the cause, P(X), contains no information about the conditional distribution P(Y|X). Consequently, estimating P(Y|X) from P(X) should not be possible. However, estimating P(X|Y) based on P(Y) may be possible. This paper employs this asymmetry to propose CURE, a causal discovery method which decides upon the causal direction by comparing the accuracy of the estimations of P(Y|X) and P(X|Y). To this end, we propose a method for estimating a conditional from samples of the corresponding marginal, which we call unsupervised inverse GP regression. We evaluate CURE on synthetic and real data. On the latter, our method outperforms existing causal inference methods. ER -
APA
Sgouritsa, E., Janzing, D., Hennig, P. & Schölkopf, B.. (2015). Inference of Cause and Effect with Unsupervised Inverse Regression. Proceedings of the Eighteenth International Conference on Artificial Intelligence and Statistics, in PMLR 38:847-855

Related Material