Abstract
Multi-dimensional classification (MDC) aims at finding a function that assigns a vector of class values to a vector of observed features. Multi-dimensional Bayesian network classifier (MBNC) was devised for MDC in 2006, but with restricted structure. By removing the constraints, an undocumented model called general multi-dimensional Bayesian network classifier (GMBNC) is proposed in this article, along with an exact induction algorithm which is able to recover the GMBNC by local search, without having to learn the whole BN first. We prove its soundness, and conduct experimental studies to verify its effectiveness and efficiency. The larger is the problem, the more saving by IPC-GMBNC versus conventional approach (global structure learning by PC algorithm), e.g. given an example network with 200 nodes, around 99% saving is achieved.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
van der Gaag, L.C., et al.: Probabilities for a probabilistic network: a case study in oesophageal cancer. Artificial Intelligence in Medicine 25(2), 123–148 (2002)
Bielza, C., Li, G., Larranga, P.: Multi-dimensional classification with Bayesian networks. International Journal of Approximate Reasoning 52(6), 705–727 (2011)
Borchani, H., Bielza, C., Larranaga, P.: Learning CB-decomposable multi-dimensional Bayesian network classifiers. In: The 5th European Workshop on Probabilistic Graphical Models (PGM 2010) (2010)
Borchani, H., Bielza, C., Larranaga, P.: Learning multi-dimensional Bayeisan network classifiers using Markov blankets: A case study in the prediction of HIV Protease inhibitors. In: AIME Workshop on Probabilistic Problem Solving in Biomedicine, Bled, Slovenia (2010)
Zaragoza, J.H., et al.: Bayesian chain classifiers for multidimensional classification. In: IJCAI (2011)
Verma, T., Peal, J.: Equivalence and Synthesis of Causal Models. In: The 6th Annual Conference on Uncertainty in Artificial Intelligence (UAI). Elsevier Science (1990)
Cheng, J., Greiner, R.: Comparing Bayesian Network Classifiers. In: The 5th Conference on Uncertainty in Artificial Intelligence (UAI) (1999)
van der Gaag, L.C., de Waal, P.R.: Multi-dimensional Bayesian network classifiers. In: Third European Workshop on Probabilistic Graphical Models, Prague (2006)
Fu, S., Desmarais, M.C.: Tradeoff analysis of different markov blanket local learning approaches. In: Washio, T., Suzuki, E., Ting, K.M., Inokuchi, A. (eds.) PAKDD 2008. LNCS (LNAI), vol. 5012, pp. 562–571. Springer, Heidelberg (2008)
Fu, S., Desmarais, M.C.: Fast Markov blanket discovery algorithm via local learning within single pass. In: Bergler, S. (ed.) Canadian AI. LNCS (LNAI), vol. 5032, pp. 96–107. Springer, Heidelberg (2008)
Fu, S., Desmarais, M.C.: Markov blanket based feature selection: A review of past decade. In: World Congress on Engineering (2010)
Spirtes, P., Glymour, C., Scheines, R.: Causation, Prediction and Search, 2nd edn. The MIT Press (2001)
Pearl, J.: Causality: Models, Reasoning, and Inference, 2nd edn. Cambridge University Press (2009)
Spirtes, P., Glymour, C., Scheines, R.: Causation, Prediction, and Search. A Bradford Book (2001)
Chickering, D.M., Geiger, D., Heckerman, D.: Learning Bayesian Network is NP-Hard, p. 22. Microsoft (1994)
Chow, C.K., Liu, C.N.: Approximating discrete probability distributions with dependence trees. IEEE Transactions on Information Theory 14(3), 462–467 (1968)
de Waal, P.R., van der Gaag, L.C.: Inference and learning in multi-dimensional Bayesian network classifiers. In: Mellouli, K. (ed.) ECSQARU 2007. LNCS (LNAI), vol. 4724, pp. 501–511. Springer, Heidelberg (2007)
Rebane, G., Pearl, J.: The Recovery of Causal Poly-Trees from statistical Data. In: Third Conference on Uncertainty in Artificial Intelligence (UAI) (1987)
Zaragoza, J.C., Sucar, E., Morales, E.: A Two-Step Method to Learn Multidimensional Bayesian Network Classifiers Based on Mutual Information Measures. In: Twenty-Fourth International FLAIRS Conference. AAAI Press, Florida (2011)
Rodriguez, J.D., Lozano, J.A.: Multi-Objective Learning of Multi-Dimensional Bayesian Classifiers. In: Eighth International Conference on Hybrid Intelligent Systems, Barcelona (2008)
Borchani, H., et al.: Markov blanket-based approach for learning multi-dimensional Bayesian network classifiers: An application to predict the European Quality of Life-5 Dimensions (EQ-5D) from the 39-item Parkinson’s Disease Questionnaire (PDQ-39). Journal of Biomedical Informatics 45(6), 1175–1184 (2012)
Borchani, H., et al.: Predicting human immunodeficiency virus inhibitors using multi-dimensional Bayeisan network classifiers. Artificial Intelligence in Medicine 57(3), 219–229 (2013)
Aliferis, C., Tsamardinos, I., Statnikov, A.: HITON, A Novel Markov Blanket Algorithm for Optimal Variable Selection. In: Annual Symposium on American Medical Informatics Association (AMIA) (2003)
Pena, J.M., et al.: Towards scalable and data efficient learning of Markov boundaries. International Journal of Approximate Reasoning 45(2), 211–232 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Fu, S., Minn, S., Desmarais, M.C. (2014). Towards the Efficient Recovery of General Multi-Dimensional Bayesian Network Classifier. In: Perner, P. (eds) Machine Learning and Data Mining in Pattern Recognition. MLDM 2014. Lecture Notes in Computer Science(), vol 8556. Springer, Cham. https://doi.org/10.1007/978-3-319-08979-9_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-08979-9_2
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08978-2
Online ISBN: 978-3-319-08979-9
eBook Packages: Computer ScienceComputer Science (R0)