Empirical Bayes Estimation in Wavelet Nonparametric Regression
Bayesian methods based on hierarchical mixture models have demonstrated excellent mean squared error properties in constructing data dependent shrinkage estimators in wavelets, however, subjective elicitation of the hyperparameters is challenging. In this chapter we use an Empirical Bayes approach to estimate the hyperparameters for each level of the wavelet decomposition, bypassing the usual difficulty of hyperparameter specification in the hierarchical model. The EB approach is computationally competitive with standard methods and offers improved MSE performance over several Bayes and classical estimators in a wide variety of examples.
KeywordsDiscrete Wavelet Transformation Shrinkage Estimator Wavelet Shrinkage Posterior Model Probability Conditional Maximum Likelihood Estimate
Unable to display preview. Download preview PDF.
- Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In 2nd International Symposium on Information Theory, Eds B.N. Petrov and F. Csaki, pp. 267–281. Budapest: Akademia Kiado.Google Scholar
- Box, G.E.P. and Tiao, G.C. (1973). Bayesian Inference in Statistical Analysis, Wiley, NY.Google Scholar
- Clyde, M. and George, E.I. (1998). “Robust Empirical Bayes Estimation in Wavelets”, ISDS Discussion Paper 98-21/ http://www.isds.duke.edu/.Google Scholar
- George, E.I. and Foster, D.P. (1997). “Empirical Bayes Variable Selection”, Tech Report, University of Texas at Austin.Google Scholar
- Johnstone, I.M. and Silverman, B.W. (1998). “Empirical Bayes approaches to mixture problems and wavelet regression”, Technical report. Department of Mathematics, University of Bristol.Google Scholar
- Yau, P. and Kohn, R. (1999). “Wavelet Nonparametric Regression Using Basis Averaging”. To appear in Bayesian Inference in Wavelet Based Models eds P. Müller and B. Vidakovic. Springer-Verlag.Google Scholar