Factual Observation Based Heterogeneity Learning for Counterfactual Prediction

Hao Zou, Haotian Wang, Renzhe Xu, Bo Li, Jian Pei, Ye Jun Jian, Peng Cui
Proceedings of the Second Conference on Causal Learning and Reasoning, PMLR 213:350-370, 2023.

Abstract

Extant causal methods exclusively exploit the heterogeneity based on the observed covariates for heterogeneous outcome prediction. Even with nowadays big data, the collected covariates may not contain complete confounders. When some confounders are absent, the methods can suffer from confounding bias and missing heterogeneity. To address these two issues, we propose to leverage the factual observation in the observational data to recover the latent confounders. Since the learned confounder representation exploits the heterogeneity of latent confounders, it leads to finer granular heterogeneous outcome prediction, which is closer to the individual-level than prediction conditional on only covariates. Specifically, we propose a novel Factual Observation based Heterogeneity Learning (FOHL) algorithm with an encoder for confounder representation learning and a decoder for outcome prediction. Theoretical analysis reveals the validity of recovering confounders from factual observations to make the heterogeneous prediction closer to the individual-level. Furthermore, experimental results demonstrate that our FOHL method can outperform the existing baselines.

Cite this Paper

BibTeX
@InProceedings{pmlr-v213-zou23a, title = {Factual Observation Based Heterogeneity Learning for Counterfactual Prediction}, author = {Zou, Hao and Wang, Haotian and Xu, Renzhe and Li, Bo and Pei, Jian and Jian, Ye Jun and Cui, Peng}, booktitle = {Proceedings of the Second Conference on Causal Learning and Reasoning}, pages = {350--370}, year = {2023}, editor = {van der Schaar, Mihaela and Zhang, Cheng and Janzing, Dominik}, volume = {213}, series = {Proceedings of Machine Learning Research}, month = {11--14 Apr}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v213/zou23a/zou23a.pdf}, url = {https://proceedings.mlr.press/v213/zou23a.html}, abstract = {Extant causal methods exclusively exploit the heterogeneity based on the observed covariates for heterogeneous outcome prediction. Even with nowadays big data, the collected covariates may not contain complete confounders. When some confounders are absent, the methods can suffer from confounding bias and missing heterogeneity. To address these two issues, we propose to leverage the factual observation in the observational data to recover the latent confounders. Since the learned confounder representation exploits the heterogeneity of latent confounders, it leads to finer granular heterogeneous outcome prediction, which is closer to the individual-level than prediction conditional on only covariates. Specifically, we propose a novel Factual Observation based Heterogeneity Learning (FOHL) algorithm with an encoder for confounder representation learning and a decoder for outcome prediction. Theoretical analysis reveals the validity of recovering confounders from factual observations to make the heterogeneous prediction closer to the individual-level. Furthermore, experimental results demonstrate that our FOHL method can outperform the existing baselines.} }
Endnote
%0 Conference Paper %T Factual Observation Based Heterogeneity Learning for Counterfactual Prediction %A Hao Zou %A Haotian Wang %A Renzhe Xu %A Bo Li %A Jian Pei %A Ye Jun Jian %A Peng Cui %B Proceedings of the Second Conference on Causal Learning and Reasoning %C Proceedings of Machine Learning Research %D 2023 %E Mihaela van der Schaar %E Cheng Zhang %E Dominik Janzing %F pmlr-v213-zou23a %I PMLR %P 350--370 %U https://proceedings.mlr.press/v213/zou23a.html %V 213 %X Extant causal methods exclusively exploit the heterogeneity based on the observed covariates for heterogeneous outcome prediction. Even with nowadays big data, the collected covariates may not contain complete confounders. When some confounders are absent, the methods can suffer from confounding bias and missing heterogeneity. To address these two issues, we propose to leverage the factual observation in the observational data to recover the latent confounders. Since the learned confounder representation exploits the heterogeneity of latent confounders, it leads to finer granular heterogeneous outcome prediction, which is closer to the individual-level than prediction conditional on only covariates. Specifically, we propose a novel Factual Observation based Heterogeneity Learning (FOHL) algorithm with an encoder for confounder representation learning and a decoder for outcome prediction. Theoretical analysis reveals the validity of recovering confounders from factual observations to make the heterogeneous prediction closer to the individual-level. Furthermore, experimental results demonstrate that our FOHL method can outperform the existing baselines.
APA
Zou, H., Wang, H., Xu, R., Li, B., Pei, J., Jian, Y.J. & Cui, P.. (2023). Factual Observation Based Heterogeneity Learning for Counterfactual Prediction. Proceedings of the Second Conference on Causal Learning and Reasoning, in Proceedings of Machine Learning Research 213:350-370 Available from https://proceedings.mlr.press/v213/zou23a.html.

Related Material