Abstract
Although various efficient and sophisticated Markov chain Monte Carlo sampling methods have been developed during the last decade, the sample mean is still a dominant in computing Bayesian posterior quantities. The sample mean is simple, but may not be efficient. The weighted sample mean is a natural generalization of the sample mean. In this paper, a new weighted sample mean is proposed by partitioning the support of posterior distribution, so that the same weight is assigned to observations that belong to the same subset in the partition. A novel application of this new weighted sample mean in computing ratios of normalizing constants and necessary theory are provided. Illustrative examples are given to demonstrate the methodology.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Berger, J. O. and Pericchi, L. R. (1996). The intrinsic Bayes factor for model selection and prediction, J. Amer. Statist. Assoc., 91, 109–122.
Casella, G. and Robert, C. P. (1996). Rao-Blackwellization of sampling schemes, Biometrika, 83, 81–94.
Casella, G. and Robert, C. P. (1998). Post-processing accept-reject samples: Recycling and rescaling, J. Comput. Graph. Statist., 7, 139–157.
Chen, M.-H. and Shao, Q.-M. (1997). On Monte Carlo methods for estimating ratios of normalizing constants, Ann. Statist., 25, 1563–1594.
Chen, M.-H., Ibrahim, J. G. and Yiannoutsos, C. (1999). Prior elicitation, variable selection, and Bayesian computation for logistic regression models, J. Roy. Statist. Soc. Ser. B, 61, 223–242.
Chib, S. (1995). Marginal likelihood from the Gibbs output, J. Amer. Statist. Assoc., 90, 1313–1321.
Gelman, A. and Meng, X.-L. (1998). Simulating normalizing constants: From importance sampling to bridge sampling to path sampling, Statist. Sci., 13, 163–185.
George, E. I. and McCulloch, R. E. (1993). Variable selection via Gibbs sampling, J. Amer. Statist. Assoc., 88, 881–889.
George, E. I. and McCulloch, R. E. (1997). Approaches for Bayesian variable selection, Statist. Sinica, 7, 339–373.
Geweke, J. (1994). Bayesian comparison of econometric models, Tech. Report, No. 532, Federal Reserve Bank of Minneapolis and University of Minnesota.
Geyer, C. J. (1994). Estimating normalizing constants and reweighting mixtures in Markov chain Monte Carlo, Revision of Tech. Report No. 568, School of Statistics, University of Minnesota.
Hammersley, J. M. and Handscomb, D. C. (1964). Monte Carlo Methods, Methuen, London.
Kass, R. E. and Raftery, A. E. (1995). Bayes factors, J. Amer. Statist. Assoc., 90, 773–795.
Liu, J. S., Liang, F. and Wong, W. H. (1998). Dynamic weighting in Markov chain Monte Carlo, Tech. Report, Department of Statistics, Stanford University, California.
Meng, X.-L. and Wong, W. H. (1996). Simulating ratios of normalizing constants via a simple identity: A theoretical exploration, Statist. Sinica, 6, 831–60.
Merigan, T. C., Amato, D. A., Balsley, J., Power, M., Price, W. A., Benoit, S., Perez-Michael, A., Brownstein, A., Kramer, A. S., Brettler, D., Aledort, L., Ragni, M. V., Andes, A. W., Gill, J. C., Goldsmith, J., Stabler, S., Sanders, N., Gjerset, G., Lusher, J. and the NHF-ACTG036 Study Group (1991). Placebo-controlled trial to evaluate zidovudine in treatment of human immunodeficiency virus infection in asymptomatic patients with hemophilia, Blood, 78, 900–906.
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H. and Teller, E. (1953). Equations of state calculations by fast computing machines, Journal of Chemical Physics, 21, 1087–1092.
Peng, L. (1998). Normalizing constant estimation for discrete distribution simulation, Ph. D. Dissertation, Department of Management Science and Information System, University of Texas at Austin (unpublished).
Thompson, S. K. (1992). Sampling, Wiley, New York.
Torrie, G. M. and Valleau, J. P. (1977). Nonphysical sampling distributions in Monte Carlo free-energy estimation: Umbrella sampling, Journal of Chemical Physics, 23, 187–199.
Trotter, H. F. and Tukey, J. W. (1956). Conditional Monte Carlo for normal samples, Symposium on Monte Carlo Methods (ed. H. A. Meyer), Wiley, New York.
Wong, W. H. and Liang, F. (1997). Dynamic weighting in Monte Carlo and optimization, Proceedings of the National Academy of Science, 94, 14220–14224.
Author information
Authors and Affiliations
About this article
Cite this article
Chen, MH., Shao, QM. Partition-Weighted Monte Carlo Estimation. Annals of the Institute of Statistical Mathematics 54, 338–354 (2002). https://doi.org/10.1023/A:1022426103047
Issue Date:
DOI: https://doi.org/10.1023/A:1022426103047