Abstract
The full Bayesian analysis of multinomial data using informative and flexible prior distributions has, in the past, been restricted by the technical problems involved in performing the numerical integrations required to obtain marginal densities for parameters and other functions thereof. In this paper it is shown that Gibbs sampling is suitable for obtaining accurate approximations to marginal densities for a large and flexible family of posterior distributions—the Å family. The method is illustrated with a three-way contingency table. Two alternative Monte Carlo strategies are also discussed.
Similar content being viewed by others
References
Aitchison, J. (1983) Principal component analysis of compositional data. Biometrika, 70, 57–65.
Aitchison, J. (1985a) A general class of distributions on the simplex. Journal of the Royal Statistical Society, B 47, 136–146.
Aitchison, J. (1985b) Practical Bayesian problems in simplex sample spaces. In Bayesian Statistics 2, ed. J. M. Bernardo et al., pp. 15–32. North Holland, Amsterdam.
Aitchison, J. (1986) The Statistical Analysis of Compositional Data. Chapman and Hall, London.
Dellaportas, J.P. and Smith, A. F. M. (1993) Bayesian inference for generalised linear and proportional hazards models via Gibbs sampling. Applied Statistics, 42, 443–459.
Devroye, L. (1986) Non-uniform Random Variate Generation. Springer-Verlag, New York.
Forster, J. J. (1992) Models and marginal densities for multiway contingency tables. PhD thesis, University of Nottingham.
Gelfand, A. E. and Smith, A. F. M. (1990) Sampling based approaches to calculating marginal densities. Journal of the American Statistical Association, 85, 398–409.
Gelman, A. and Rubin, D. B. (1992) Inference from iterative simulation using multiple sequences. Statistical Science, 7, 457–472.
Gilks, W. R. and Wild, P. (1992) Adaptive rejection sampling for Gibbs sampling. Applied Statistics, 41, 337–348.
Hastings, W. K. (1970) Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57, 97–109.
Hills, S. E. and Smith, A. F. M. (1992) Parameterization issues in Bayesian inference. In Bayesian Statistics 4, ed. J. M. Bernardo, et al., pp. 227–246. Oxford University Press.
Johnson, N. L. and Kotz, S. (1972) Distributions in Statistics: Continuous Multivariate Distributions. Wiley, New York.
Knuiman, M. W. and Speed, T. P. (1988) Incorporating prior information into the analysis of contingency tables. Biometrics, 44, 1061–1071.
Leonard, T. (1975) Bayesian estimation methods for two-way contingency tables. Journal of the Royal Statistical Society, B 37, 23–37.
Lindley, D. V. (1964) The Bayesian analysis of contingency tables. Annals of Mathematical Statistics, 35, 1622–1643.
Nazaret, W. A. (1987) Bayesian log linear estimates for three-way contingency tables. Biometrika, 74, 401–410.
Rubin, D. B. (1988) Using the SIR algorithm to simulate posterior distributions. In Bayesian Statistics 3, ed. J. M. Bernardo et al., pp. 395–402. Oxford University Press.
Silverman, B. (1986) Density Estimation for Statistics and Data Analysis. Chapman and Hall, London.
Smith, A. F. M. and Roberts, G. O. (1993) Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods. Journal of the Royal Statistical Society B, 55, 3–23.
Smith, A. F. M., Skene, A. M., Shaw, J. E. H. and Naylor, J. C. (1987) Progress with numerical and graphical methods for practical Bayesian statistics. The Statistician, 36, 75–82.
Wild, P. and Gilks, W. R. (1993) Algorithm AS287: Adaptive rejection sampling from log-concave density functions. Applied Statistics, 42, 701–709.
Zeger, S. L. and Karim, M. R. (1991) Generalized linear models with random effects: a Gibbs sampling approach. Journal of the American Statistical Association, 86, 79–86.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Forster, J.J., Skene, A.M. Calculation of marginal densities for parameters of multinomial distributions. Stat Comput 4, 279–286 (1994). https://doi.org/10.1007/BF00156751
Issue Date:
DOI: https://doi.org/10.1007/BF00156751