Skip to main content

Active Learning for Causal Bayesian Network Structure with Non-symmetrical Entropy

  • Conference paper
Advances in Knowledge Discovery and Data Mining (PAKDD 2009)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5476))

Included in the following conference series:

Abstract

Causal knowledge is crucial for facilitating comprehension, diagnosis, prediction, and control in automated reasoning. Active learning in causal Bayesian networks involves interventions by manipulating specific variables, and observing the patterns of change over other variables to derive causal knowledge. In this paper, we propose a new active learning approach that supports interventions with node selection. Our method admits a node selection criterion based on non-symmetrical entropy from the current data and a stop criterion based on structure entropy of the resulting networks. We examine the technical challenges and practical issues involved. Experimental results on a set of benchmark Bayesian networks are promising. The proposed method is potentially useful in many real-life applications where multiple instances are collected as a data set in each active learning step.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cooper, G.F., Herskovits, E.: A Bayesian method for the induction of probabilistic networks from data. Machine Learning 9, 309–347

    Google Scholar 

  2. Cooper, G.F., Yoo, C.: Causal discovery from a mixture of experimental and observational data. In: Proceedings of the Fifteenth Annual Conference on Uncertainty in Artificial Intelligence, pp. 116–125. Morgan Kaufmann Publishers, San Francisco (1999)

    Google Scholar 

  3. Eaton, D., Murphy, K.: Exact Bayesian structure learning from uncertain interventions. In: AI & Statistics, pp. 107–114 (2007)

    Google Scholar 

  4. Eberhardt, F., Glymour, C., Scheines, R.: On the Number of Experiments Sufficient and in the Worst Case Necessary to Identify All Causal Relations Among N Variables. In: UAI 2005, pp. 178–184. AUAI Press (2005)

    Google Scholar 

  5. Heckerman, D.: A Tutorial on Learning with Bayesian Networks. In: Jordan, M. (ed.) Learning in Graphical Models, pp. 301–354. MIT Press, Cambridge (1998)

    Chapter  Google Scholar 

  6. Heckerman, D., Geiger, D., Chickering, D.M.: Learning Bayesian networks: The combination of knowledge and statistical data. Machine Learning 20, 197–243

    Google Scholar 

  7. Koivisto, M.: Advances in exact Bayesian structure discovery in Bayesian networks. In: UAI 2006, pp. 241–248. AUAI Press (2006)

    Google Scholar 

  8. Korb, K.B., Hope, L., Nicholson, A.E., Axnick, K.: Varieties of causal intervention. In: Zhang, C., Guesgen, H.W., Yeap, W.-K. (eds.) PRICAI 2004. LNCS (LNAI), vol. 3157, pp. 322–331. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  9. Li, G.: Knowledge Discovery with Bayesian Networks, PhD Thesis Department of Computer Science, National University of Singapore, 1–210 (submitted, 2009)

    Google Scholar 

  10. Pearl, J.: Causality: models, reasoning, and inference. Cambridge University Press, New York (2000)

    MATH  Google Scholar 

  11. Sachs, K., Perez, O., Pe’er, D., Lauffenburger, D.A., Nolan, G.P.: Causal Protein-Signaling Networks Derived from Multiparameter Single-Cell Data. Science 308(5721), 523–529

    Google Scholar 

  12. Spirtes, P., Glymour, C., Scheines, R.: Causation, Prediction, and Search, 2nd edn. MIT Press, Cambridge (2000)

    MATH  Google Scholar 

  13. Tian, J., Pearl, J.: Causal Discovery from Changes. In: Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence (UAI), pp. 512–521. Morgan Kaufmann, San Francisco (2001)

    Google Scholar 

  14. Tong, S., Koller, D.: Active Learning for Structure in Bayesian Networks. In: IJCAI 2001, pp. 863–869. Morgan Kaufmann, Washington (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Li, G., Leong, TY. (2009). Active Learning for Causal Bayesian Network Structure with Non-symmetrical Entropy. In: Theeramunkong, T., Kijsirikul, B., Cercone, N., Ho, TB. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2009. Lecture Notes in Computer Science(), vol 5476. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01307-2_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-01307-2_28

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-01306-5

  • Online ISBN: 978-3-642-01307-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics