Abstract
The problem of estimating the probability of unobserved outcomes or, as it is sometimes called, the conditional probability of a new species, is studied. Good's estimator, which is essentially the same as Robbins' estimator, namely the number of singleton species observed divided by the sample size, is studied from a decision theory point of view. The results obtained are as follows: (1) When the total number of different species is assumed bounded by some known number, Good's and Robbins' estimators are inadmissible for squared error loss. (2) If the number of different species can be infinite, Good's and Robbins' estimators are admissible for squared error loss. (3) Whereas Robbins' estimator is a UMVUE for theunconditional probability of a new species obtained in one extra sample point, Robbins' estimator is not a uniformly minimum mean squared error unbiased estimator of the conditional probability of a new species. This answers a question raised by Robbins. (4) It is shown that for Robbins' model and squared error loss, there are admissible Bayes estimators which do not depend only on a minimal sufficient statistic. A discussion of interpretations and significance of the results is offered.
Similar content being viewed by others
References
Clayton, M. K. and Frees, W. (1987). Nonparametric estimation of the probability of discovering a new species.J. Amer. Statist. Assoc.,82, 305–311.
Esty, W. W. (1986). The efficiency of Good's nonparametric coverage estimator,Ann. Statist.,14, 1257–1260.
Ferguson, T. S. (1967).Mathematical Statistics, A Decision Theoretic Approach, Academic Press, New York.
Good, I. (1953). On the population frequencies of species and the estimation of population parameters,Biometrika,40, 237–264.
LeCam, L. (1955). An extension of Wald's theory or statistical decision functions,Ann. Math. Statist.,26, 69–81.
Lehmann, E. L. (1986).Testing Statistical Hypotheses, Second Edition, Wiley, New York.
Robbins, H. (1968). Estimating the total probability of the unobserved outcome of an experiment,Ann. Math. Statist.,39, 256–257.
Starr, N. (1979). Linear estimation of the probability of discovering a new species,Ann. Statist.,1, 644–652.
Wald, A. (1950).Statistical Decision Functions, Wiley, New York.
Author information
Authors and Affiliations
Additional information
Research supported by NSF Grant DMS-88-22622.
About this article
Cite this article
Cohen, A., Sackrowitz, H.B. Admissibility of estimators of the probability of unobserved outcomes. Ann Inst Stat Math 42, 623–636 (1990). https://doi.org/10.1007/BF02481141
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02481141