Searching Optimal Bayesian Network Structure on Constraint Search Space: Super-Structure Approach

  • Seiya Imoto
  • Kaname Kojima
  • Eric Perrier
  • Yoshinori Tamada
  • Satoru Miyano
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6797)


Optimal search on Bayesian network structure is known as an NP-hard problem and the applicability of existing optimal algorithms is limited in small Bayesian networks with 30 nodes or so. To learn larger Bayesian networks from observational data, some heuristic algorithms were used, but only a local optimal structure is found and its accuracy is not high in many cases. In this paper, we review optimal search algorithms in a constraint search space; The skeleton of the learned Bayesian network is a sub-graph of the given undirected graph called super-structure. The introduced optimal search algorithm can learn Bayesian networks with several hundreds of nodes when the degree of super-structure is around four. Numerical experiments indicate that constraint optimal search outperforms state-of-the-art heuristic algorithms in terms of accuracy, even if the super-structure is also learned by data.


Bayesian networks Structural learning Optimal algorithm Constraint search space Super-structure 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Friedman, N., Linial, M., Nachman, I., Peér, D.: Using Bayesian network to analyze expression data. J. Comp. Biol. 7, 601–620 (2000)CrossRefGoogle Scholar
  2. 2.
    Heckerman, D., Geiger, D., Chickering, D.M.: Learning Bayesian networks: the combination of knowledge and statistical data. Machine Learning 20, 197–243 (1995)zbMATHGoogle Scholar
  3. 3.
    Imoto, S., Goto, T., Miyano, S.: Estimation of genetic networks and functional structures between genes by using Bayesian network and nonparametric regression. In: Pacific Symposium on Biocomputing, vol. 7, pp. 175–186 (2002)Google Scholar
  4. 4.
    Koivisto, M., Sood, K.: Exact Bayesian structure discovery in Bayesian networks. Journal of Machine Learning Research 5, 549–573 (2004)MathSciNetzbMATHGoogle Scholar
  5. 5.
    Kojima, K., Perrier, E., Imoto, S., Miyano, S.: Optimal search on clustered structural constraint for learning Bayesian network structure. Journal of Machine Learning Research 11, 285–310 (2010)MathSciNetzbMATHGoogle Scholar
  6. 6.
    Ott, S., Imoto, S., Miyano, S.: Finding optimal models for small gene networks. In: Pacific Symposium on Biocomputing, vol. 9, pp. 557–567 (2004)Google Scholar
  7. 7.
    Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufman Publishers, San Mateo (1988)zbMATHGoogle Scholar
  8. 8.
    Parviainen, P., Koivisto, M.: Exact structure discovery in Bayesian networks with less space. In: Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (2009)Google Scholar
  9. 9.
    Perrier, E., Imoto, S., Miyano, S.: Finding optimal Bayesian network given a super-structure. Journal of Machine Learning Research 9, 2251–2286 (2008)MathSciNetzbMATHGoogle Scholar
  10. 10.
    Silander, T., Myllymaki, P.: A simple approach for finding the globally optimal Bayesian network structure. In: Conference on Uncertainty in Artificial Intelligence, pp. 445–452 (2006)Google Scholar
  11. 11.
    Singh, A.P., Moore, A.W.: Finding optimal Bayesian networks by dynamic programming. In: Technical report, Carnegie Mellon University (2005)Google Scholar
  12. 12.
    Tamada, Y., Imoto, S., Miyano, S.: Parallel algorithm for learning optimal Bayesian network structure (submitted for publication)Google Scholar
  13. 13.
    Tsamardinos, I., Brown, L.E., Aliferis, C.F.: The max-min hill-climbing Bayesian network structure learning algorithm. Machine Learning 65, 31–78 (2006)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Seiya Imoto
    • 1
  • Kaname Kojima
    • 1
  • Eric Perrier
    • 1
  • Yoshinori Tamada
    • 1
  • Satoru Miyano
    • 1
  1. 1.Human Genome Center, Institute of Medical ScienceUniversity of TokyoMinato-kuJapan

Personalised recommendations