Advertisement

Bayesian Metanetwork for Context-Sensitive Feature Relevance

  • Vagan Terziyan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3955)

Abstract

Bayesian Networks are proven to be a comprehensive model to describe causal relationships among domain attributes with probabilistic measure of appropriate conditional dependency. However, depending on task and context, many attributes of the model might not be relevant. If a network has been learned across multiple contexts then all uncovered conditional dependencies are averaged over all contexts and cannot guarantee high predictive accuracy when applied to a concrete case. We are considering a context as a set of contextual attributes, which are not directly effect probability distribution of the target attributes, but they effect on a “relevance” of the predictive attributes towards target attributes. In this paper we use the Bayesian Metanetwork vision to model such context-sensitive feature relevance. Such model assumes that the relevance of predictive attributes in a Bayesian network might be a random attribute itself and it provides a tool to reason based not only on probabilities of predictive attributes but also on their relevancies. According to this model, the evidence observed about contextual attributes is used to extract a relevant substructure from a Bayesian network model and then the predictive attributes evidence is used to reason about probability distribution of the target attribute in the extracted sub-network. We provide the basic architecture for such Bayesian Metanetwork, basic reasoning formalism and some examples.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Francisco (1988)zbMATHGoogle Scholar
  2. 2.
    Henrion, M.: Some Practical Issues in Constructing Belief Networks. In: Proceedings of the 3rd Annual Conference on Uncertainty in Artificial Intelligence, pp. 161–174. Elsevier, Amsterdam (1989)Google Scholar
  3. 3.
    Heckerman, D.: A Tutorial on Learning with Bayesian Networks, Technical Report MSR-TR-95-06, Microsoft Research (March 1995)Google Scholar
  4. 4.
    Butz, C.J.: Exploiting Contextual Independencies in Web Search and User Profiling. In: Proc. of the World Congress on Computational Intelligence, Hawaii, USA, pp. 1051–1056 (2002)Google Scholar
  5. 5.
    Boutiler, C., Friedman, N., Goldszmidt, M., Koller, D.: Context-Specific Independence in Bayesian Networks. In: Proceedings of the 12th Conference on Uncertainty in Artificial Intelligence, Portland, USA, pp. 115–123 (1996)Google Scholar
  6. 6.
    Zhang, N.L.: Inference in Bayesian networks: The Role of Context-Specific Independence. International Journal of Information Technology and Decision Making 1(1), 91–119 (2002)CrossRefGoogle Scholar
  7. 7.
    Geiger, D., Heckerman, D.: Knowledge Representation and Inference in Similarity Networks and Bayesian Multinets. Artificial Intelligence 82, 45–74 (1996)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian Network Classifiers. Machine Learning 29(2-3), 131–161 (1997)CrossRefzbMATHGoogle Scholar
  9. 9.
    Cheng, J., Greiner, R.: Learning bayesian belief network classifiers: Algorithms and system. In: Stroulia, E., Matwin, S. (eds.) Canadian AI 2001. LNCS, vol. 2056, pp. 141–151. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  10. 10.
    Pena, J., Lozano, J.A., Larranaga, P.: Learning Bayesian Networks for Clustering by Means of Constructive Induction. Machine Learning 47(1), 63–90 (2002)CrossRefzbMATHGoogle Scholar
  11. 11.
    Terziyan, V.: A Bayesian Metanetwork. International Journal on Artificial Intelligence Tools 14(3), 371–384 (2005)CrossRefGoogle Scholar
  12. 12.
    Terziyan, V.Y., Vitko, O.: Bayesian metanetworks for modelling user preferences in mobile environment. In: Günter, A., Kruse, R., Neumann, B. (eds.) KI 2003. LNCS, vol. 2821, pp. 370–384. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  13. 13.
    Terziyan, Vitko, O.: Learning Bayesian Metanetworks from Data with Multilevel Uncertainty. In: Bramer, M., Devedzic, V. (eds.) Proc. of the First IFIP International Conf. on Artificial Intelligence and Innovations, Toulouse, France, pp. 187–196. Kluwer, Dordrecht (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Vagan Terziyan
    • 1
  1. 1.Industrial Ontologies Group, Agora CenterUniversity of JyvaskylaJyvaskylaFinland

Personalised recommendations