Skip to main content
SpringerLink
Log in

Generic reversible jump MCMC using graphical models

  • Published:
Statistics and Computing Aims and scope Submit manuscript

Abstract

Markov chain Monte Carlo techniques have revolutionized the field of Bayesian statistics. Their power is so great that they can even accommodate situations in which the structure of the statistical model itself is uncertain. However, the analysis of such trans-dimensional (TD) models is not easy and available software may lack the flexibility required for dealing with the complexities of real data, often because it does not allow the TD model to be simply part of some bigger model. In this paper we describe a class of widely applicable TD models that can be represented by a generic graphical model, which may be incorporated into arbitrary other graphical structures without significantly affecting the mechanism of inference. We also present a decomposition of the reversible jump algorithm into abstract and problem-specific components, which provides infrastructure for applying the method to all models in the class considered. These developments represent a first step towards a context-free method for implementing TD models that will facilitate their use by applied scientists for the practical exploration of model uncertainty. Our approach makes use of the popular WinBUGS framework as a sampling engine and we illustrate its use via two simple examples in which model uncertainty is a key feature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Al-Awadhi, F., Hurn, M.A., Jennison, C.: Improving the acceptance rates of reversible jump MCMC proposals. Stat. Probab. Lett. 69, 189–198 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  • Albert, J.H., Chib, S.: Bayesian analysis of binary and polychotomous response data. J. Am. Stat. Assoc. 88, 669–679 (1993)

    Article  MATH  MathSciNet  Google Scholar 

  • Bernardo, J.M., Smith, A.F.M.: Bayesian Theory. Wiley, New York (1994)

    Book  MATH  Google Scholar 

  • Brooks, S.P., Gelman, A.: General methods for monitoring convergence of iterative simulations. J. Comput. Graph. Stat. 7, 434–455 (1998)

    Article  MathSciNet  Google Scholar 

  • Brooks, S.P., Giudici, P.: Convergence assessment for reversible jump MCMC simulations. In: Bernardo, J.M., Berger, J.O., Dawid, A.P., Smith, A.F.M. (eds.) Bayesian Statistics, vol. 6, pp. 733–742. Oxford University Press, Oxford (1999)

    Google Scholar 

  • Brooks, S.P., Giudici, P., Roberts, G.O.: Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions (with discussion). J. R. Stat. Soc. B 65, 3–55 (2003)

    Article  MATH  MathSciNet  Google Scholar 

  • Castelloe, J.M., Zimmerman, D.L.: Convergence assessment for reversible jump MCMC samplers. Technical Report 313, Department of Statistics and Actuarial Science, University of Iowa (2002)

  • Cowles, M.K., Carlin, B.P.: Markov chain Monte Carlo convergence diagnostics: a comparative review. J. Am. Stat. Assoc. 91, 883–904 (1996)

    Article  MATH  MathSciNet  Google Scholar 

  • Denison, D.G., Holmes, C.C.: Bayesian partitioning for estimating disease risk. Biometrics 57, 143–149 (2001)

    Article  MathSciNet  Google Scholar 

  • Denison, D.G.T., Mallick, B.K., Smith, A.F.M.: Automatic Bayesian curve fitting. J. R. Stat. Soc. B 60, 333–350 (1998a)

    Article  MATH  MathSciNet  Google Scholar 

  • Denison, D.G.T., Mallick, B.K., Smith, A.F.M.: A Bayesian CART algorithm. Biometrika 85, 363–377 (1998b)

    Article  MATH  MathSciNet  Google Scholar 

  • Denison, D.G.T., Mallick, B.K., Smith, A.F.M.: Bayesian MARS. Stat. Comput. 8, 337–346 (1998c)

    Article  Google Scholar 

  • Denison, D.G.T., Holmes, C.C., Mallick, B.K., Smith, A.F.M.: Bayesian Methods for Non-linear Classification and Regression. Wiley, Chichester (2002)

    Google Scholar 

  • Draper, N., Smith, H.: Applied Regression Analysis, 2nd edn. Wiley, New York (1981)

    MATH  Google Scholar 

  • Frühwirth-Schnatter, S., Wagner, H.: Data augmentation and Gibbs sampling for regression models of small counts. Technical report, IFAS, Johannes Kepler Universität Linz, Austria, http://www.ifas.jku.at/ (2004)

  • Gelfand, A.E., Smith, A.F.M.: Sampling-based approaches to calculating marginal densities. J. Am. Stat. Assoc. 85, 398–409 (1990)

    Article  MATH  MathSciNet  Google Scholar 

  • Gelman, A., Rubin, D.B.: Inference from iterative simulation using multiple sequences (with discussion). Stat. Sci. 7, 457–511 (1992)

    Article  Google Scholar 

  • Geman, S., Geman, D.: Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images. IEEE Trans. Pattern Anal. 6, 721–741 (1984)

    Article  MATH  Google Scholar 

  • Gilks, W.R.: Full conditional distributions. In: Gilks, W.R., Richardson, S., Spiegelhalter, D.J. (eds.) Markov Chain Monte Carlo in Practice, pp. 75–88. Chapman & Hall, London (1996)

    Google Scholar 

  • Green, P.J.: Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82, 711–732 (1995)

    Article  MATH  MathSciNet  Google Scholar 

  • Green, P.J.: Trans-dimensional Markov chain Monte Carlo. In: Green, P.J., Hjort, N.L., Richardson, S. (eds.) Highly Structured Stochastic Systems, pp. 179–206. Oxford University Press, London (2003)

    Google Scholar 

  • Green, P.J., Mira, A.: Delayed rejection in reversible jump Metropolis-Hastings. Biometrika 88, 1035–1053 (2001)

    MATH  MathSciNet  Google Scholar 

  • Harrell, F.E.: Regression Modelling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis. Springer, London (2001)

    Google Scholar 

  • Hastie, D.I.: (2005). Towards automatic reversible jump Markov chain Monte Carlo. PhD thesis, Statistics Group, University of Bristol, UK

  • Hastie, T., Tibshirani, R.: Generalized Additive Models. Chapman & Hall, London (1990)

    MATH  Google Scholar 

  • Hastings, W.K.: Monte Carlo sampling-based methods using Markov chains and their applications. Biometrika 57, 97–109 (1970)

    Article  MATH  Google Scholar 

  • Holmes, C.C., Held, L.: Bayesian auxiliary variable models for binary and multinomial regression. Bayesian Anal. 1, 145–168 (2005)

    MathSciNet  Google Scholar 

  • Jasra, A., Stephens, D.A., Holmes, C.C.: Population-based reversible jump Markov chain Monte Carlo. arxiv:0711.0186 (2007)

  • Johnson, N.L., Kotz, S.: Distributions in Statistics: Continuous Multivariate. Wiley, New York (1972)

    MATH  Google Scholar 

  • Knorr-Held, L., Raßer, G.: Bayesian detection of clusters and discontinuities in disease maps. Biometrics 56, 13–21 (2000)

    Article  MATH  Google Scholar 

  • Lunn, D.J.: Automated covariate selection and Bayesian model averaging in population PK/PD models. J. Pharmacokinet. Pharmacodyn. 35, 85–100 (2008)

    Article  Google Scholar 

  • Lunn, D.J., Thomas, A., Best, N., Spiegelhalter, D.: WinBUGS—a Bayesian modelling framework: concepts, structure, and extensibility. Stat. Comput. 10, 325–337 (2000)

    Article  Google Scholar 

  • Lunn, D.J., Whittaker, J.C., Best, N.: A Bayesian toolkit for genetic association studies. Genet. Epidemiol. 30, 231–247 (2006)

    Article  Google Scholar 

  • Mengersen, K.L., Robert, C.P., Guihenneuc-Jouyaux, C.: MCMC convergence diagnostics: a review. In: Bernardo, J.M., Berger, J.O., Dawid, A.P., Smith, A.F.M. (eds.) Bayesian Statistics, vol. 6, pp. 415–440. Oxford University Press, Oxford (1999)

    Google Scholar 

  • Metropolis, N., Rosenbluth, A.W., Rosenbluth, M.N., Teller, A.H., Teller, E.: Equations of state calculations by fast computing machines. J. Chem. Phys. 21, 1087–1091 (1953)

    Article  Google Scholar 

  • Nobile, A., Fearnside, A.T.: Bayesian finite mixtures with an unknown number of components: The allocation sampler. Stat. Comput. 17, 147–162 (2007)

    Article  MathSciNet  Google Scholar 

  • Richardson, S., Green, P.J.: On Bayesian analysis of mixtures with an unknown number of components. J. R. Stat. Soc. B 59, 731–792 (1997)

    Article  MATH  MathSciNet  Google Scholar 

  • Spanos, A., Harrell, F.E., Durack, D.T.: Differential diagnosis of acute meningitis: An analysis of the predictive value of initial observations. J. Am. Med. Assoc. 262, 2700–2707 (1989)

    Article  Google Scholar 

  • Spiegelhalter, D.J., Thomas, A., Best, N.G.: Computation on Bayesian graphical models. In: Bernardo, J.M., Berger, J.O., Dawid, A.P., Smith, A.F.M. (eds.) Bayesian Statistics, vol. 5, pp. 407–425. Oxford University Press, Oxford (1996)

    Google Scholar 

  • Spiegelhalter, D., Thomas, A., Best, N., Gilks, W.: BUGS 0.5: Bayesian inference Using Gibbs Sampling. Manual (version ii), Medical Research Council Biostatistics Unit, Cambridge (1996)

  • Spiegelhalter, D., Thomas, A., Best, N., Lunn, D.: WinBUGS User Manual, Version 1.4. Medical Research Council Biostatistics Unit, Cambridge (2003)

  • Troughton, P.T., Godsill, S.J.: A reversible jump sampler for autoregressive time series, employing full conditionals to achieve efficient model space moves. Technical Report CUED/F-INFENG/TR. 304, Cambridge University Engineering Department, UK (1997)

  • Waagepetersen, R., Sorensen, D.: A tutorial on reversible jump MCMC with a view toward applications in QTL-mapping. Int. Stat. Rev. 69, 49–61 (2001)

    Article  MATH  Google Scholar 

  • Wakefield, J.C., Smith, A.F.M., Racine-Poon, A., Gelfand, A.E.: Bayesian analysis of linear and non-linear population models by using the Gibbs sampler. Appl. Stat. 43, 201–221 (1994)

    Article  MATH  Google Scholar 

  • Zellner, A.: On assessing prior distributions and Bayesian regression analysis with g prior distributions. In: Goel, P., Zellner, A. (eds.) Bayesian Inference and Decision Techniques—Essays in Honor of Bruno De Finetti, pp. 233–243. Elsevier, Amsterdam (1986)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. MRC Biostatistics Unit, Institute of Public Health, University Forvie Site, Robinson Way, Cambridge, CB2 0SR, UK

    David J. Lunn

  2. Department of Epidemiology and Public Health, Imperial College London, London, UK

    Nicky Best

  3. Department of Epidemiology and Population Health, London School of Hygiene and Tropical Medicine, London, UK

    John C. Whittaker

Authors
  1. David J. Lunn
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nicky Best
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. John C. Whittaker
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to David J. Lunn.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lunn, D.J., Best, N. & Whittaker, J.C. Generic reversible jump MCMC using graphical models. Stat Comput 19, 395 (2009). https://doi.org/10.1007/s11222-008-9100-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11222-008-9100-0

Keywords

Search

Navigation