Summary
The usual Bayes-Stein shrinkages of maximum likelihood estimates towards a common value may be refined by taking fuller account of the locations of the individual observations. Under a Bayesian formulation, the types of shrinkages depend critically upon the nature of the common distribution assumed for the parameters at the second stage of the prior model. In the present paper this distribution is estimated empirically from the data, permitting the data to determine the nature of the shrinkages. For example, when the observations are located in two or more clearly distinct groups, the maximum likelihood estimates are roughly speaking constrained towards common values within each group. The method also detects outliers; an extreme observation will either the regarded as an outlier and not substantially adjusted towards the other observations, or it will be rejected as an outlier, in which case a more radical adjustment takes place. The method is appropriate for a wide range of sampling distributions and may also be viewed as an alternative to standard multiple comparisons, cluster analysis, and nonparametric kernel methods.
Similar content being viewed by others
References
Clevenson, M. and Zidek, J. W. (1975). Simultaneous estimation of the means of independent Poisson laws,J. Amer. Statist Ass.,70, 698–705.
Dawid, A. P. (1973). Posterior expectation for large observations,Biometrika,61, 664–667.
Efron, B. and Morris, C. (1973a). Stein's estimation rule and its competitors—an empirical Bayes approach,J. Amer. Statist. Ass.,68, 117–130.
Efron, B. and Morris, C. (1973b). Combining possibly related estimation problems (with discussion),J. R. Statist. Soc., B,36, 379–421.
Efron, B. and Morris, C. (1975). Data analysis using Stein's estimator and its generalizations.J. Amer. Statist. Ass.,70, 311–319.
James, W. and Stein, C. (1961). Estimation with quadratic loss,Proc. 4th Berkeley Symposium,1, 361–379.
Laird, N. M. (1978). Non-parametric maximum likelihood estimation of a mixing distribution,J. Amer. Statist. Ass.,73, 805–811.
Leonard, T. (1972). Bayesian methods for binomial data,Biometrika,59, 581–589.
Leonard, T. (1978). Density estimation, stochastic processes, and prior information (with discussion),J. R. Statist. Soc., B,40, 113–146.
Lindley, D. V. and Smith, A. F. M. (1972). Bayes estimates for the linear model (with discussion),J. R. Statist. Soc., B,34, 1–41.
Lindsay, B. G. (1981). Properties of the maximum likelihood estimator of a mixing distribution, inStatistical Distributions in Scientific Work (ed. C. Taillie et al.), Vol. 5, 95–109.
Lindsay, B. G. (1982a). A geometry of mixture likelihoods: A general theory,Penn. State Univ. Tech. Report.
Lindsay, B. G. (1983a). A geometry of mixture likelihoods, Part II: The exponential family,J. Amer. Statist. Ass.,4, 1200–1209.
Pearson, K. (1904). On the theory of contingency and its relation to association and normal correlation,Drapers Co. Res. Mem. Biometrics Series.
Robbins, H. (1964). The empirical Bayes approach to statistical decision problems,Ann. Math. Statist.,35, 1289–1302.
Silverman, B. W. (1978). Choosing the window width when estimating a density,Biometrika,65, 1–12.
Simar, L. (1976). Maximum likelihood estimation of a compound Poisson process,Ann. Statist.,4, 1200–1209.
Author information
Authors and Affiliations
About this article
Cite this article
Leonard, T. Some data-analytic modifications to Bayes-Stein estimation. Ann Inst Stat Math 36, 11–21 (1984). https://doi.org/10.1007/BF02481949
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/BF02481949