Improving Bayesian Network Structure Search with Random Variable Aggregation Hierarchies
Bayesian network structure identification is known to be NP-Hard in the general case. We demonstrate a heuristic search for structure identification based on aggregationhierarchies. The basic idea is to perform initial exhaustive searches on composite “high-level” random variables (RVs) that are created via aggregations of atomic RVs. The results of the high-level searches then constrain a refined search on the atomic RVs. We demonstrate our methods on a challenging real-world neuroimaging domain and show that they consistently yield higher scoring networks when compared to traditional searches, provided sufficient topological complexity is permitted. On simulated data, where ground truth is known and controllable, our methods yield improved classification accuracy and structural precision, but can also result in reduced structural recall on particularly noisy datasets.
KeywordsBayesian network structure search hierarchy fMRI
Unable to display preview. Download preview PDF.
- 1.Anderson, C., Domingos, P., Weld, D.: Relational Markov models and their application to adaptive web navigation. In: KDD, pp.143–152 (2002)Google Scholar
- 4.Chickering, D., Geiger, D., Heckerman, D.: Learning Bayesian Networks is NP-Hard. Technical Report MSR-TR-94-17, Microsoft (1994)Google Scholar
- 5.Clark, V.P., Friedman, L., Manoach, D., Ho, B.C., Lim, K., Andreasen, N.: A collaborative fMRI study of the novelty oddball task in schizophrenia: Effects of illness duration. Society for Neuroscience Abstracts, 474.9 (2005)Google Scholar
- 6.Dartmouth fMRI Data Center, The (2006), http://www.fmridc.org/f/fmridc
- 8.Grossman, D., Domingos, P.: Learning Bayesian Network Classifiers by Maximizing Conditional Likelihood. In: ICML, vol. 21, pp. 361–368 (2004)Google Scholar
- 9.Gyftodimos, E., Flach, P.: Hierarchical Bayesian Networks: An Approach to Classification and Learning for Structured Data. In: Proceedings of Methods and Applications of Artificial Intelligence, Third Hellenic Conference in AI, pp. 291–300 (2004)Google Scholar
- 14.Margaritis, D., Thrun, S.: Bayesian Network Induction via Local Neighborhoods. In: Advances in Neural Information Processing Systems 12, Denver, CO (1999)Google Scholar
- 15.McCallum, A., Rosenfeld, R., Mitchell, T., Ng, A.Y.: Improving Text Classification by Shrinkage in a Hierarchy of Classes. In: ICML (1998)Google Scholar
- 16.The MIND Institute (2006), http://www.themindinstitute.org/