Abstract
We present a method for using posterior samples produced by the computer program BUGS (Bayesian inference Using Gibbs Sampling) to obtain approximate profile likelihood functions of parameters or functions of parameters in directed graphical models with incomplete data. The method can also be used to approximate integrated likelihood functions. It is easily implemented and it performs a good approximation. The profile likelihood represents an aspect of the parameter uncertainty which does not depend on the specification of prior distributions, and it can be used as a worthwhile supplement to BUGS that enable us to do both Bayesian and likelihood based analyses in directed graphical models.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Andersen H.H. 1997. Monte Carlo likelihood in complex graphical models. Ph.D. Thesis, Department of Mathematical Sciences, Aalborg University, Aalborg, Denmark.
Berger J.O., Liseo B., and Wolpert R.L. 1999. Integrated likelihood methods for eliminating nuisance parameters. Statistical Science 14(1): 1–28.
Best N.G., Cowles M.K., and Vines K. 1996. CODA, Convergence Diagnosis and Output Analysis Software for Gibbs Sampling Output, Version 0.30. MRC Biostatistics Unit, Cambridge.
Brooks S.P. 1998. Markov chain Monte Carlo method and its application. The Statistician 47: 69–100.
Gaver D.P. and O'Muircheartaigh I.G. 1987. Robust empirical Bayes analyses of event rates. Technometrics 29: 1–15.
Gelfand A.E. and Smith A.F.M. 1990. Sampling-based approaches to calculating marginal densities. Journal of the American Statistical Association 85: 398–409.
Geman S. and Geman D. 1984. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence 6(6): 721–741.
George E.I., Makov U.E., and Smith A.F.M. 1993. Conjugate likelihood distributions. Scandinavian Journal of Statistics 20: 147–156.
Geyer C.J. 1994. On the convergence of Monte Carlo maximum likelihood calculations. Journal of the Royal Statistical Society, Series B 56(1): 261–274.
Geyer C.J. 1996. Estimation and optimization of functions. In: Gilks W.R., Richardson S., and Spiegelhalter D.J. (Eds.), Markov Chain Monte Carlo in Practice. Chapman and Hall, New York, pp. 241–258.
Geyer C.J. and Thompson E.A. 1992. Constrained Monte Carlo maximum likelihood for dependent data. Journal of the Royal Statistical Society, Series B 54(3): 657–699.
Gilks W.R., Richardson S., and Spiegelhalter D.J. (Eds.). 1996. Markov Chain Monte Carlo in Practice. Chapman and Hall, New York.
Hastings W.K. 1970. Monte Carlo sampling methods using Markov chains and their applications. Biometrika 57(1): 97–109.
Hundborg H.H., Højbjerre M., Christiansen O.B., and Lauritzen S.L. 2000. Familial tendency to foetal loss analysed with Bayesian graphical models by Gibbs sampling. Statistics in Medicine 19: 2147–2168.
Højbjerre M. 2001a. Familial tendency to foetal loss analysed with directed graphical models by MCMC profile log-likelihood. Technical Report R-01-2018, Department of Mathematical Sciences, Aalborg University, Aalborg, Denmark.
Højbjerre M. 2001b. Profile likelihood in directed graphical models from BUGS output. In: Jaakkola T. and Richardson T. (Eds.), Proceedings of the Eight InternationalWorkshop on Artificial Intelligence and Statistics. Morgan Kaufmann Publishers, San Fransisco, pp. 208–213.
Lauritzen S.L. 1996. Graphical Models. Clarendon Press, Oxford, UK.
Lauritzen S.L., Dawid A.P., Larsen B.N., and Leimer H.-G. 1990. Independence properties of directed Markov fields. Networks 20: 491–505.
Metropolis N., Rosenbluth A.W., Rosenbluth M.N., Teller A.H., and Teller E. 1953. Equations of state calculations by fast computing machine. Journal of Chemical Physics 21: 1087–1091.
Spiegelhalter D.J. 1998. Bayesian graphical modelling: A case-study in monitoring health outcomes. Applied Statistics 47: 115–133.
Spiegelhalter D.J., Thomas A., Best N.G., and Gilks W. 1996a. BUGS 0.5 Bayesian Inference Using Gibbs Sampling Manual (Version II). MRC Biostatistics Unit, Cambridge.
Spiegelhalter D.J., Thomas A., Best N.G., and Gilks W. 1996b. BUGS 0.5 Examples Vol. 1 (Version I). MRC Biostatistics Unit, Cambridge.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Højbjerre, M. Profile likelihood in directed graphical models from BUGS output. Statistics and Computing 13, 57–66 (2003). https://doi.org/10.1023/A:1021939828576
Issue Date:
DOI: https://doi.org/10.1023/A:1021939828576