Skip to main content

Grammar-Guided Evolutionary Construction of Bayesian Networks

  • Conference paper
Foundations on Natural and Artificial Computation (IWINAC 2011)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 6686))

Abstract

This paper proposes the EvoBANE system. EvoBANE automatically generates Bayesian networks for solving special-purpose problems. EvoBANE evolves a population of individuals that codify Bayesian networks until it finds near optimal individual that solves a given classification problem. EvoBANE has the flexibility to modify the constraints that condition the solution search space, self-adapting to the specifications of the problem to be solved. The system extends the GGEAS architecture. GGEAS is a general-purpose grammar-guided evolutionary automatic system, whose modular structure favors its application to the automatic construction of intelligent systems. EvoBANE has been applied to two classification benchmark datasets belonging to different application domains, and statistically compared with a genetic algorithm performing the same tasks. Results show that the proposed system performed better, as it manages different complexity constraints in order to find the simplest solution that best solves every problem.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wong, M.L., Guo, Y.Y.: Learning bayesian networks from incomplete databases using a novel evolutionary algorithm. Decision Support Systems 45, 368–383 (2008)

    Article  Google Scholar 

  2. Darwiche, A.: Bayesian networks. Communications of the ACM 53(12), 80–90 (2010)

    Article  MATH  Google Scholar 

  3. Niedermayer, D.: An Introduction to Bayesian Networks and Their Contemporary Applications. In: Innovations in Bayesian Networks. SCI, pp. 117–130. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  4. Chen, X., Anantha, G., Lin, X.: Improving bayesian network structure learning with mutual information-based node ordering in the k2 algorithm. IEEE Transactions on Knowledge and Data Engineering 20(5), 1–13 (2008)

    Article  Google Scholar 

  5. Larrañaga, P., Poza, M., Yurramendi, Y., Murga, R.H., Kuijpers, C.M.H.: Structure learning of bayesian networks by genetic algorithms: A performance analysis of control parameters. IEEE Transactions on Pattern Analysis and Machine Intelligence 18(9), 912–926 (1996)

    Article  Google Scholar 

  6. Barriére, O., Lutton, E., Wuillemin, P.: Bayesian network structure learning using cooperative coevolution. In: GECCO 2009, Montréal, Canada, July 2009, pp. 755–762 (2009)

    Google Scholar 

  7. Alonso-Barba, J.I., delaOssa, L., Puerta, J.M.: Structural learning of bayesian networks by using variable neighbourhood search based on the space of orderings. In: Ninth Conference on Intelligent Systems Design and Applications, pp. 1435–1440 (2009)

    Google Scholar 

  8. Font, J.M., Manrique, D., Ríos, J.: Evolutionary construction and adaptation of intelligent systems. Expert Systems with Applications 37, 7711–7720 (2010)

    Article  Google Scholar 

  9. Koza, J.: Genetic programming: On the programming of computers by means of natural selection. The MIT Press, Cambridge (1992)

    MATH  Google Scholar 

  10. Dong, L., Liu, G., Yuan, S., Li, Y., Li, Z.: Classifier learning algorithm based on genetic algorithms. In: ICICIC 2007 Second International Conference on Innovative Computing, Information and Control, September 2007, pp. 126–129 (2007)

    Google Scholar 

  11. Larrañaga, P., Kuijpers, C.M.H., Murga, R.H., Yurramendi, Y.: Learning bayesian network structures by searching for the best ordering with genetic algorithms. IEEE Transactions on Systems, Man and Cybernetics-Part A: Systems and Humans 26(4), 487–493 (1996)

    Article  Google Scholar 

  12. De Stefano, C., Fontanella, F., Scotto di Freca, A., Marcelli, A.: Learning bayesian networks by evolution for classifier combination. In: 10th International Conference on Document Analysis and Recognition, pp. 966–970 (2009)

    Google Scholar 

  13. Davidson, C.: Identifying gene regulatory networks using evolutionary algorithms. Journal of Computing Sciences in Colleges 25(5), 231–237 (2010)

    Google Scholar 

  14. Wong, M.L., Lee, Y.L., Leung, K.S.: A hybrid approach to learn bayesian networks using evolutionary programming. In: WCCI 2002 Proceedings of the 2002 World Congress on Computational Intelligence, vol. 2, pp. 1314–1319 (2002)

    Google Scholar 

  15. Lee, J., Chung, W., Kim, E.: Structure learning of bayesian networks using dual genetic algorithm. IEICE Transactions on Informations and Systems E91-D(1), 32–43 (2008)

    Article  Google Scholar 

  16. Palacios-Alonso, M.A., Brizuela, C.A., Sucar, L.E.: Evolutionary learning of dynamic naive bayesian classifiers. Journal on Automated Reasononing 45, 21–37 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  17. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The weka data mining software: An update. SIGKDD Explorations 11(1), 10–18 (2009)

    Article  Google Scholar 

  18. Font, J.M., Manrique, D.: Grammar-guided evolutionary automatic system for autonomously building biological oscillators. IEEE Congress on Evolutionary Computation, 1–7 (July 2010)

    Google Scholar 

  19. Couchet, J., Manrique, D., Ríos, J., Rodríguez-Patón, A.: Crossover and mutation operators for grammar-guided genetic programming. Soft Computing: A Fusion of Foundations, Methodologies and Applications 11(10), 943–955 (2007)

    Article  Google Scholar 

  20. Frank, A., Asuncion, A.: UCI machine learning repository. University of California, Irvine, School of Information and Computer Sciences (2010), http://archive.ics.uci.edu/ml

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Font, J.M., Manrique, D., Pascua, E. (2011). Grammar-Guided Evolutionary Construction of Bayesian Networks. In: Ferrández, J.M., Álvarez Sánchez, J.R., de la Paz, F., Toledo, F.J. (eds) Foundations on Natural and Artificial Computation. IWINAC 2011. Lecture Notes in Computer Science, vol 6686. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21344-1_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-21344-1_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-21343-4

  • Online ISBN: 978-3-642-21344-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics