Abstract
We consider the empirical Bayes decision problem where the component problem is the sequential estimation of the mean θ of one-parameter exponential family of distributions with squared error loss for the estimation error and a cost c>0 for each observation. The present paper studies the untruncated sequential component case. In particular, an untruncated asymptotically pointwise optimal sequential procedure is employed as the component. With sequential components, an empirical Bayes decision procedure selects both a stopping time and a terminal decision rule for use in the component with parameter θ. The goodness of the empirical Bayes sequential procedure is measured by comparing the asymptotic behavior of its Bayes risk with that of the component procedure as the number of past data increases to infinity. Asymptotic risk equivalence of the proposed empirical Bayes sequential procedure to the component procedure is demonstrated.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ash, Robert B. (1972). Real Analysis and Probability, Academic Press, New York.
Berger, J. O. (1985). Statistical Decision Theory and Bayesian Analysis, 2nd ed., Springer, New York.
Bickel, P. and Yahav, J. (1967). Asymptotically pointwise optimal procedures in sequential analysis, Proc. 5th Berkeley Symp. on Math. Statist. Prob., VI, 401–413, University of California Press, Berkeley.
Bickel, P. and Yahav, J. (1969). An A.P.O. rule in sequential estimation with quadratic loss, Ann. Math. Statist., 40, 417–426.
Chow, Y. S., Robbins, H. and Siegmund, D. (1971). Great Expectations: The Theory of Optimal Stopping, Houghton-Mifflin, Boston.
Diaconis, P. and Ylvisaker, D. (1979). Conjugate priors for exponential families, Ann. Statist., 6, 269–281.
Ferguson, T. S. (1967). Mathematical Statistics. A Decision Theoretic Approach, Academic Press, New York.
Ghosh, M. (1991). Hierarchical and empirical Bayes sequential estimation, Handbook of Sequential Analysis (eds. B. K. Ghosh and P. K. Sen), 441–458, Marcel Dekker, New York.
Ghosh, M. and Hoekstra, R. M. (1989). A.P.O. rules in heirarchical and empirical Bayes models, Sequential Analysis, 79–100.
Ghosh, M. and Lahiri, P. (1987). Robust empirical Bayes estimation of means from stratified samples, J. Amer. Statist. Assoc., 82, 1153–1162.
Gilliland, D. C. and Karunamuni, R. J. (1988). On empirical Bayes with sequential component, Ann. Inst. Statist. Math., 40, 187–193.
Good, I. J. (1965). The Estimation of Probabilities. An Essay on Modern Bayesian Methods, M.I.T. Press, Cambridge, Massachusetts.
Hoekstra, M. (1989). Asymptotically pointwise optimal stopping rules in multiparameter estimation, Ph.D. Dissertation, Department of Statistics, University of Florida (unpublished).
Karunamuni, R. J. (1985). Empirical Bayes with sequential components, Ph.D. dissertation, Department of Statistics and Probability, Michigan State University.
Karunamuni, R. J. (1988). On empirical Bayes testing with sequential components, Ann. Statist., 16, 1270–1282.
Karunamuni, R. J. (1989). On empirical Bayes sequential estimation, Comm. Statist. Theorey Methods, 18, 2533–2552.
Karunamuni, R. J. (1990). On the empirical Bayes approach to multiple decision problems with sequential components, Ann. Inst. Statist. Math., 42, 637–655.
Laippala, P. (1979). The empirical Bayes approach with floating sample size in binomial experimentation, Scand. J. Statist., 6, 113–118 (Correction: ibid. (1980), 7, p. 105).
Laippala, P. (1985). The empirical Bayes rules with floating optimal sample size for exponential conditional distributions, Ann. Inst. Statist. Math., 37, 315–327.
Lehmann, E. L. (1986). Testing Statistical Hypotheses, 2nd ed., Wiley, New York.
Lindlay, D. V. and Smith, A. F. M. (1972). Bayes estimators for the linear model (with discussion), J. Roy. Statist. Soc. Ser. B, 34, 1–41.
Maritz, J. S. and Lwin, T. (1989). Empirical Bayes Methods, 2nd ed., Chapman and Hall, London.
Martinsek, A. T. (1987). Empirical Bayes methods in sequential estimation, Sequential Anal., 6, 119–137.
Morris, C. (1983a). Parametric empirical Bayes inference: theory and applications, J. Amer. Statist. Assoc., 78, 47–65.
Morris, C. (1983b). Parametric empirical Bayes confidence sets, Scientific Inference, Data Analysis, and Robutness (eds. G. E. P. Box, T. Lenonard and C. F. Wu), 25–50, Academic Press, New York.
Rehailia, M. E. H. (1984). Asymptotic sequential analysis on the A.P.O. rule performance, Sequential Anal., 3, 155–174.
Robbins, H. (1959). An empirical Bayes approach to statistics, Proc. Third Berkeley Symp. on Math. Statist. Prob., Vol. 1, 157–163, University of California Press, Berkeley.
Robbins, H. (1959). Sequential estimation of the mean of a normal population, Probability and Statistics (the H. Cramér volume), Almqvist and Wiksell, Stockholm.
Robbins, H. (1963). The empirical Bayes approach to testing statistical hypotheses, Review of the International Statistical Institute, 31, 195–208.
Robbins, H. (1964). The empirical Bayes approach to statistical problems, Ann. Math. Statist., 35, 1–20.
Sen, P. K. (1981). Sequential Nonparametrics, Wiley, New York.
Shapiro, C. P. and Wardrop, R. L. (1980). Bayesian sequential estimation for one-parameter exponential families, J. Amer. Statist. Assoc., 75, 984–988.
Woodroofe, M. (1981). A.P.O. rules are asymptotically non-deficient for estimation with squared error loss, Zeitschrift für Wahrscheinlichkeitstheorie und verwandte Gabiete, 58, 331–341.
Woodroofe, M. (1982). Nonlinear renewal theory in sequential analysis, CBMS-NSF Regional Conf. Ser. in Appl. Math., Society for Industrial and Applied Mathematics, Philadelphia, Pennsylvania.
Author information
Authors and Affiliations
Additional information
This research was supported in part by the Natural Sciences and Engineering Research Council of Canada under grant GP7987.
About this article
Cite this article
Karunamuni, R.J. Empirical Bayes sequential estimation for exponential families: The untruncated component. Ann Inst Stat Math 48, 711–730 (1996). https://doi.org/10.1007/BF00052329
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF00052329