Abstract
This chapter describes graphical models for multivariate continuous data based on the Gaussian (normal) distribution. We gently introduce the undirected models by examining the partial correlation structure of two sets of data, one relating to meat composition of pig carcasses and the other to body fat measurements. We then give a concise exposition of the model theory, covering topics such as maximum likelihood estimation using the IPS algorithm, hypothesis testing, and decomposability. We also explain the close relation between the models and linear regression models. We describe various approaches to model selection, including stepwise selection, the glasso algorithm and the SIN algorithm and apply these to the example datasets. We then turn to directed Gaussian graphical models that can be represented as DAGs. We explain a key concept, Markov equivalence, and describe how certain mixed graphs called pDAGS and essential graphs are used to represent equivalence classes of models. We describe various model selection algorithms for directed Gaussian models, including PC algorithm, the hill-climbing algorithm, and the max-min hill-climbing algorithm and apply them to the example datasets. Finally, we briefly describe Gaussian chain graph models and illustrate use of a model selection algorithm for these models.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Akaike H (1974) A new look at the statistical identification problem. IEEE Trans Autom Control 19:716–723
Andersson SA, Madigan D, Perlman MD (1996) A characterization of Markov equivalence classes for acyclic digraphs. Ann Stat 25:505–541
Busk H, Olsen EV, Brøndum J (1999) Determination of lean meat in pig carcasses with the Autofom classification system. Meat Sci 52:307–314
Chickering DM (2002) Equivalence classes of Bayesian network structure. J Mach Learn Res 2:445–498
Dempster AP (1972) Covariance selection. Biometrics 28:157–175
Drton M, Perlman MD (2007) Multiple testing and error control in Gaussian graphical model selection. Stat Sci 22:430–449
Drton M, Perlman MD (2008) A SINful approach to Gaussian graphical model selection. J Stat Plan Inference 138:1179–1200
Friedman J, Hastie T, Tibshirani R (2008) Sparse inverse covariance estimation with the graphical lasso. Biostatistics 9(3):432–441
Frydenberg M (1990a) The chain graph Markov property. Scand J Stat 17:333–353
Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat 6:65–70
Johnson RW (1996) Fitting percentage of body fat to simple body measurements. Journal of Statistics Education 4:1
Lauritzen SL (1996) Graphical models. Clarendon Press, Oxford
Ma Z, Xie X, Geng Z (2008) Structural learning of chain graphs via decomposition. J Mach Learn Res 9:2847–2880
Pearl J (2000) Causality. Cambridge University Press, Cambridge
Schwarz G (1978) Estimating the dimension of a model. Ann Math Stat 6:461–464
Sidak Z (1967) Rectangular confidence regions for the means of multivariate normal distributions. J Am Stat Assoc 62(318):626–633. http://www.jstor.org/stable/2283989
Speed TP, Kiiveri H (1986) Gaussian Markov distributions over finite graphs. Ann Math Stat 14:138–150
Spirtes P, Glymour C (1991) An algorithm for fast recovery of sparse causal graphs. Soc Sci Comput Rev 9(1):62–72. http://ssc.sagepub.com/content/9/1/62.abstract
Spirtes P, Glymour C, Scheines R (1993) Causation, prediction and search. Springer, New York, reprinted by MIT Press
Tsamardinos I, Aliferis C, Statnikov A (2003) Algorithms for large scale Markov blanket discovery. In: Proceedings of the sixteenth international Florida artificial intelligence research society conference
Verma T, Pearl J (1990) Equivalence and synthesis of causal models. In: Bonissone PP, Henrion M, Kanal LN, Lemmer JF (eds) Uncertainty in artificial intelligence, vol. 6. North-Holland, Amsterdam, pp 255–268
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Højsgaard, S., Edwards, D., Lauritzen, S. (2012). Gaussian Graphical Models. In: Graphical Models with R. Use R!. Springer, Boston, MA. https://doi.org/10.1007/978-1-4614-2299-0_4
Download citation
DOI: https://doi.org/10.1007/978-1-4614-2299-0_4
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4614-2298-3
Online ISBN: 978-1-4614-2299-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)