Abstract
Empirical Bayes point estimates of latent trait scores, derived under the assumptions of one of several test theory models, display a certain degree of instability unless the sample size is sufficiently large. A measure of this instability over repeated sampling is the distribution of the overall expected squared error loss which converges, both in probability and in the mean, to the minimum (Bayes) overall expected loss as sample size increases. An asymptotic distribution theory is developed, and the resulting large sample approximation is compared with results obtained from simulated data. Attention is also given to the effects of using a smoothing procedure.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
George, S. L. Evaluation of empirical Bayes estimators for small numbers of past samples.Biometrika, 1971,58, 244.
Horst, P.Factor analysis of data matrices. New York: Holt, Rinehart and Winston, 1965.
Johnson, N. L., Nixon, E., and Amos, D. E. Table of percentage points of Pearson curves, for given √β 1, andβ 2 expressed in standard measure.Biometrika, 1963,50, 459–498.
Kearns, J. Empirical Bayes point estimates of true score using a compound binomial error model. Research Memorandum 74-11. Princeton, N.J.: Educational Testing Service, 1974.
Keats, J. and Lord, F. M. A theoretical distribution for mental test scores.Psychometrika, 1962,27, 59–72.
Kendall, M. S. and Stuart, A.The advanced theory of statistics. Vol. 1. New York: Hafner, 1969.
Kotz, S., Johnson, N. L., and Boyd, D. W. Series representations of distributions of quadratic ratic forms in normal variables. I. Central case.Annals of Mathematical Statistics, 1967,38, 823–837.
Lord, F. M. An approach to mental test theory.Psychometrika, 1959,24, 283–302.
Lord, F. M. A strong true-score theory with applications.Psychometrika, 1965,30, 239–270.
Lord, F. M. Estimating true-score distributions in psychological testing (an empirical Bayes estimation problem).Psychometrika, 1969,34, 259–299.
Lord, F. M. and Novick, M. R.Statistical theories of mental test scores. Reading, Mass.: Addison-Wesley, 1968.
Lukacs, E. and Laha, R. G.Applications of characteristic functions. London: Griffin, 1964.
Maritz, J. S.Empirical Bayes methods. London: Methuen, 1970.
Meredith, W. M. Poisson distributions of error in mental test theory.British Journal of Mathematical and Statistical Psychology, 1971,24, 49–82.
Meredith, W. M. and Kearns, J. Empirical Bayes point estimates of latent trait scores without knowledge of the trait distribution.Psychometrika, 1973,38, 533–554.
Rao, C. R.Linear statistical inference and its applications. New York: Wiley, 1965.
Rasch, G.Probabilistic models for some intelligence and attainment tests. Copenhagen: Danmarks Paedagogiske Institut, 1960.
Rasch, G. An item analysis which takes individual differences into account.British Journal of Mathematical and Statistical Psychology, 1966,19, 49–57.
Robbins, H. An empirical Bayes approach to statistics.Proceedings of the Third Berkeley Symposium on Mathematical and Statistical Probability, 1955,1, 157–164.
Robbins, H. The empirical Bayes approach to statistical decision problems.Annals of Mathematical Statistics, 1964,35, 1–20.
Author information
Authors and Affiliations
Additional information
Research leading to this paper was partially supported by the National Science Foundation, Division of Biological and Medical Sciences, Program in Psychobiology, Grant No. NSF-GB-30779.
The authors are indebted to Thomas W. F. Stroud and Noel Cressie for their reviews of an earlier version of this paper and to Frederic M. Lord for helpful comments and suggestions.
Rights and permissions
About this article
Cite this article
Kearns, J., Meredith, W. Methods for evaluating empirical bayes point estimates of latent trait scores. Psychometrika 40, 373–394 (1975). https://doi.org/10.1007/BF02291764
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02291764