Skip to main content

Learning Attentive Fusion of Multiple Bayesian Network Classifiers

  • Conference paper
  • 3136 Accesses

Part of the Lecture Notes in Computer Science book series (LNTCS,volume 7665)

Abstract

Using Bayesian networks (BNs) for classification tasks has received significant attention as BNs can encode and represent domain-experts’ knowledge as well as data in their structures and conditional probability tables. While structure learning and constructing the structure by hand according to an ensemble of domain-expert opinions are two common approaches to make a BN structure, finding an optimal structure to attain a high correct classification rate -especially for high dimensional problems- is still a challenging task. In this paper we propose a framework - called Local Bayesian Network Experts Fusion (LoBNEF) - in that, instead of making a single network, multiple Bayesian Network Classifiers (BNCs) are built and their outputs are attentively fused. The attentive fusion process is learned interactively using a Bayesian reinforcement learning method. We demonstrate that learning different BNCs in the first step and then fusing their decisions in an attentive and sequential manner is an efficient and robust method in terms of correct classification rate.

Keywords

  • Bayesian Network
  • Decision Fusion
  • Reinforcement Learning

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Greiner, R., Su, X., Shen, B., Zhou, W.: Structural extension to logistic regression: Discriminative parameter learning of belief net classifiers. Machine Learning 322, 297–322 (2005)

    CrossRef  Google Scholar 

  2. Su, J., Zhang, H., Ling, C., Matwin, S.: Discriminative parameter learning for bayesian networks. In: Proceedings of the 25th International Conference on Machine Learning, pp. 1016–1023 (2008)

    Google Scholar 

  3. Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Machine Learning 29(2), 131–163 (1997)

    CrossRef  MATH  Google Scholar 

  4. Grossman, D., Domingos, P.: Learning bayesian network classifiers by maximizing conditional likelihood. In: Proceedings of the Twenty-First International Conference on Machine Learning (2004)

    Google Scholar 

  5. Carvalho, A., Roos, T., Oliveira, A., Myllymäki, P., et al.: Discriminative learning of bayesian networks via factorized conditional log-likelihood. Journal of Machine Learning Research (2011)

    Google Scholar 

  6. Geiger, D., Heckerman, D.: Knowledge representation and inference in similarity networks and bayesian multinets. Artificial Intelligence 82(1-2), 45–74 (1996)

    CrossRef  MathSciNet  Google Scholar 

  7. Jing, Y., Pavlovi, V., Rehg, J.: Boosted bayesian network classifiers. Machine Learning 73(2), 155–184 (2008)

    CrossRef  Google Scholar 

  8. Mirian, M.S., Ahmadabadi, M.N., Araabi, B.N., Siegwart, R.R.: Learning active fusion of multiple experts’ decisions: An attention-based approach. Neural Computation 23(2), 558–591 (2011)

    CrossRef  Google Scholar 

  9. Firouzi, H., Ahmadabadi, M., Araabi, B., Amizadeh, S., Mirian, M., Siegwart, R.: Interactive learning in continuous multimodal space: A bayesian approach to action based soft partitioning and learning. IEEE Transactions on Autonomous Mental Development (99) (2011)

    Google Scholar 

  10. Newman, D., Hettich, S., Blake, C., Merz, C.: Uci repository of machine learning databases. Department of Information and Computer Science. University of California, Irvine (1998)

    Google Scholar 

  11. Jing, Y., Pavlovi, V., Rehg, J.: Efficient discriminative learning of bayesian network classifier via boosted augmented naive bayes. In: Proceedings of the 22nd International Conference on Machine Learning, pp. 369–376 (2005)

    Google Scholar 

  12. Ridgeway, G., Madigan, D., Richardson, T., Okane, J.: Interpretable boosted naive bayes classification. In: Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining, pp. 101–104. AAAI Press (1998)

    Google Scholar 

  13. Fayyad, U., Irani, K.: Multi-interval discretization of continuous-valued attributes for classification learning (1993)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Eghbali, S., Ahmadabadi, M.N., Araabi, B.N., Mirian, M. (2012). Learning Attentive Fusion of Multiple Bayesian Network Classifiers. In: Huang, T., Zeng, Z., Li, C., Leung, C.S. (eds) Neural Information Processing. ICONIP 2012. Lecture Notes in Computer Science, vol 7665. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34487-9_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34487-9_17

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34486-2

  • Online ISBN: 978-3-642-34487-9

  • eBook Packages: Computer ScienceComputer Science (R0)