Advertisement

Asymptotic Properties of Nonparametric Bayesian Procedures

  • Larry Wasserman
Part of the Lecture Notes in Statistics book series (LNS, volume 133)

Abstract

This chapter provides a brief review of some large sample frequentist properties of nonparametric Bayesian procedures. The review is not comprehensive, but rather, is meant to give a simple, heuristic introduction to some of the main concepts. We mainly focus on consistency but we touch on a few other issues as well.

Keywords

Positive Mass Hellinger Distance Dirichlet Process Mixture Weak Neighborhood Polya Tree 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barron, A. (1988). “The exponential convergence of posterior probabilities with implications for Bayes estimators of density functions.” Technical Report 7, Department of Statistics, University of Illinois, Champaign, IL.Google Scholar
  2. Barron, A., Schervish, M. and Wasserman, L. (1997). “The consistency of posterior distributions in nonparametric problems.” Technical report, Department of Statistics, Carnegie Mellon.Google Scholar
  3. Cox, D. (1993). “An analysis of Bayesian inference for nonparametric regression.” The Annals of Statistics, 21, 903–923.MathSciNetMATHCrossRefGoogle Scholar
  4. Diaconis, P. and Freedman, D. (1997). “On the Bernstein-von Mises Theorem with Infinite Dimensional Parameters,” unpublished manuscript.Google Scholar
  5. Diaconis, P. and Freedman, D. (1986). “On the consistency Bayes estimates.” The Annals of Statistics,14, 1–26.MathSciNetMATHCrossRefGoogle Scholar
  6. Diaconis, P. and Freedman, D. (1993). “Nonparametric binary regression: A Bayesian approach.” The Annals of Statistics, 21, 2108–2137.MathSciNetMATHCrossRefGoogle Scholar
  7. Doob, J.L. (1949). “Application of the theory of martingales.” In Le Calcul des Probabilités et ses Applications, 23–27. Colloques Internationaux du Centre National de la Recherche Scientifique, Paris.Google Scholar
  8. Freedman, D. (1963), “On the asymptotic behavior of Bayes’ estimates in the discrete case.” The Annals of Mathematical Statistics, 34, 1386–1403.CrossRefGoogle Scholar
  9. Freedman, D. (1965), “On the asymptotic behavior of Bayes’ estimates in the discrete case, II.” The Annals of Mathematical Statistics, 36, 454–456.CrossRefGoogle Scholar
  10. Ghosh, J.K. and Ramamoorthi, R.V. (1997). Lecture Notes on Bayesian Asymptotics, Under preparation.Google Scholar
  11. Ghoshal, S., Ghosh, J.K. and Ramamoorthi, R.V. (1997a). “Consistency issues in Bayesian nonparametrics,” unpublished manuscript.Google Scholar
  12. Ghoshal, S., Ghosh, J.K. and Ramamoorthi, R.V. (1997b). “Posterior consistency of Dirichlet mixtures in density estimation,” unpublished manuscript.Google Scholar
  13. Kass, R.E. and Wasserman, L. (1996). “The selection of prior distributions by formal rules.” Journal of the American Statistical Association, 91, 1343–1370.MATHCrossRefGoogle Scholar
  14. Robins, J. and Ritov, Y. (1997). “Toward a curse of dimensionality appropriate asymptotic theory for semiparametric models.” To appear: Statistics and Medicine. Google Scholar
  15. Schwartz, L. (1960). “Consistency of Bayes procedures.” Ph.D. dissertation, University of California.Google Scholar
  16. Schwartz, L. (1965). “On Bayes procedures.” Z. Wahrsch. Verw. Gebiete 4, 10–26.MATHCrossRefGoogle Scholar
  17. Shen, X. (1995). “On the properties of Bayes procedures in general parameter spaces.” Unpublished manuscript.Google Scholar
  18. Tierney, L. (1987). “Asymptotic nonparametric posterior distributions,” Technical report 497, Department of Statistics, University of Minnesota.Google Scholar
  19. van der Vaart, A. and Weliner, J. (1996). Weak Convergence and Empirical Processes. Springer: New York.MATHGoogle Scholar
  20. Wasserman, L. (1997). “Asymptotic inference for mixture models using data dependent priors,” In preparation.Google Scholar
  21. Wong, W.H. and Shen, X. (1995). “Probability inequalities for likelihood ratios and convergence rates of sieve MLE’s.” Annals of Statistics, 23, 339–362.MathSciNetMATHCrossRefGoogle Scholar
  22. Zhao, L. (1993). “Frequentist and Bayesian aspects of some nonparametric estimation.” Ph.D. Thesis, Cornell University.Google Scholar
  23. Zhao, L. (1997). “Bayesian Aspects of Some Nonparametric Problems.” Technical report, University of Pennsylvania.Google Scholar

Copyright information

© Springer Science+Business Media New York 1998

Authors and Affiliations

  • Larry Wasserman

There are no affiliations available

Personalised recommendations