Hidden Node Detection between Two Observable Nodes Based on Bayesian Clustering

Keisuke Yamazaki; Yoichi Motomura

Hidden Node Detection between Two Observable Nodes Based on Bayesian Clustering

Keisuke Yamazaki, Yoichi Motomura

Proceedings of The 3rd International Workshop on Advanced Methodologies for Bayesian Networks, PMLR 73:165-175, 2017.

Abstract

The structure learning is one of the main concerns in studies of the Bayesian networks. In the present paper, we consider the network consisting of both observable and hidden nodes, and propose a method to investigate the existence of a hidden node between two observable nodes, which is the model selection problem between the networks with and without the middle hidden node. When the network includes a hidden node, it has been known that there are singularities in the parameter space, and the Fisher information matrix is not positive definite. Then, the many conventional criteria for the structure learning based on the Laplace approximation do not work. The proposed method is based on the Bayesian clustering, and its asymptotic property justifies the result; the redundant labels are eliminated and the simplest structure is detected even if there are singularities.

Cite this Paper

BibTeX


@InProceedings{pmlr-v73-yamazaki17a,
  title = 	 {Hidden Node Detection between Two Observable Nodes Based on Bayesian Clustering},
  author = 	 {Yamazaki, Keisuke and Motomura, Yoichi},
  booktitle = 	 {Proceedings of The 3rd International Workshop on Advanced Methodologies for Bayesian Networks},
  pages = 	 {165--175},
  year = 	 {2017},
  editor = 	 {Hyttinen, Antti and Suzuki, Joe and Malone, Brandon},
  volume = 	 {73},
  series = 	 {Proceedings of Machine Learning Research},
  month = 	 {20--22 Sep},
  publisher =    {PMLR},
  pdf = 	 {http://proceedings.mlr.press/v73/yamazaki17a/yamazaki17a.pdf},
  url = 	 {https://proceedings.mlr.press/v73/yamazaki17a.html},
  abstract = 	 {The structure learning is one of the main concerns in studies of the Bayesian networks.
 In the present paper, we consider the network consisting of both observable and hidden nodes,
 and propose a method to investigate the existence of a hidden node between two observable nodes,
 which is the model selection problem between the networks with and without the middle hidden node.
 When the network includes a hidden node, it has been known that there are singularities in the parameter space,
 and the Fisher information matrix is not positive definite.
 Then, the many conventional criteria for the structure learning based on the Laplace approximation do not work.
 The proposed method is based on the Bayesian clustering,
 and its asymptotic property justifies the result; the redundant labels are eliminated and the simplest structure is detected
 even if there are singularities.}
}

Endnote

%0 Conference Paper
%T Hidden Node Detection between Two Observable Nodes Based on Bayesian Clustering
%A Keisuke Yamazaki
%A Yoichi Motomura
%B Proceedings of The 3rd International Workshop on Advanced Methodologies for Bayesian Networks
%C Proceedings of Machine Learning Research
%D 2017
%E Antti Hyttinen
%E Joe Suzuki
%E Brandon Malone	
%F pmlr-v73-yamazaki17a
%I PMLR
%P 165--175
%U https://proceedings.mlr.press/v73/yamazaki17a.html
%V 73
%X The structure learning is one of the main concerns in studies of the Bayesian networks.
 In the present paper, we consider the network consisting of both observable and hidden nodes,
 and propose a method to investigate the existence of a hidden node between two observable nodes,
 which is the model selection problem between the networks with and without the middle hidden node.
 When the network includes a hidden node, it has been known that there are singularities in the parameter space,
 and the Fisher information matrix is not positive definite.
 Then, the many conventional criteria for the structure learning based on the Laplace approximation do not work.
 The proposed method is based on the Bayesian clustering,
 and its asymptotic property justifies the result; the redundant labels are eliminated and the simplest structure is detected
 even if there are singularities.

APA


Yamazaki, K. & Motomura, Y.. (2017). Hidden Node Detection between Two Observable Nodes Based on Bayesian Clustering. Proceedings of The 3rd International Workshop on Advanced Methodologies for Bayesian Networks, in Proceedings of Machine Learning Research 73:165-175 Available from https://proceedings.mlr.press/v73/yamazaki17a.html.

Related Material

Download PDF