Psychometrika

, Volume 34, Issue 3, pp 259–299 | Cite as

Estimating true-score distributions in psychological testing (an empirical bayes estimation problem)

  • Frederic M. Lord
Article

Abstract

The following problem is considered: Given that the frequency distribution of the errors of measurement is known, determine or estimate the distribution of true scores from the distribution of observed scores for a group of examinees. Typically this problem does not have a unique solution. However, if the true-score distribution is “smooth,” then any two smooth solutions to the problem will differ little from each other. Methods for finding smooth solutions are developed a) for a population and b) for a sample of examinees. The results of a number of tryouts on actual test data are summarized.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aitkin, A. C., & Gonin, H. T. On fourfold sampling with and without replacement.Proceedings of the Royal Society of Edinburgh, 1935,55, 114–125.Google Scholar
  2. Deely, J. J., & Kruse, R. L. Construction of sequences estimating the mixing distribution.The Annals of Mathematical Statistics, 1968,39, 286–288.Google Scholar
  3. Eisenberg, H. B., Geoghagen, R. R. M., & Walsh, J. E. A general probability model for binomial events with application to surgical mortality.Biometrics, 1963,19, 152–157.Google Scholar
  4. Jordan, C.Calculus of finite differences. (2nd ed.) New York: Chelsea, 1947.Google Scholar
  5. Kendall, M. G., & Stuart, A.The advanced theory of statistics. New York: Hafner, 1958–61, 2 volumes.Google Scholar
  6. Kenneth, P., & Taylor, G. E. Solution of variational problems with bounded control variables by means of the generalized Newton-Raphson method. In A. Lavi & T. Vogl (Eds.),Recent advances in optimization techniques. New York: Wiley, 1966.Google Scholar
  7. Leitmann, G. Variational problems with bounded control variables. In G. Leitmann (Ed.),Optimization techniques. New York: Academic Press, 1962. Pp. 171–204.Google Scholar
  8. Lord, F. M. A theory of test scores.Psychometric Monograph, 1952, No. 7.Google Scholar
  9. Lord, F. M. A strong true-score theory, with applications.Psychometrika, 1965,30, 239–270.Google Scholar
  10. Lord, F. M. Estimating item characteristic curves without knowledge of their mathematical form. ETS Research Bulletin 68-8 and ONR Technical Report, Contract Nonr-2752(00). Princeton, N. J.: Educational Testing Service, 1968.Google Scholar
  11. Lord, F. M., & Lees, Dinan. Estimating true-score distributions for mental tests (Methods 12, 14, 15). ETS Research Memorandum 67-1 and ONR Technical Report, Contract Nonr-2752(00). Princeton, N. J.: Educational Testing Service, 1967. (a)Google Scholar
  12. Lord, F. M., & Lees, Diana. Estimating true-score distributions for mental tests (Method 16). ETS Research Bulletin 67-7 and ONR Technical Report, Contract Nonr-2752(00). Princeton, N. J.: Educational Testing Service, 1967. (b)Google Scholar
  13. Lord, F. M., & Novick, M. R.Statistical theories of mental test scores. Reading, Mass.: Addison-Wesley, 1968.Google Scholar
  14. Maritz, J. S. Smooth empirical Bayes estimation for one-parameter discrete distributions.Biometrika, 1966,53, 417–429.Google Scholar
  15. Pars, L. A.An introduction to the calculus of variations. London: Heinemann, 1962.Google Scholar
  16. Phillips, D. L. A technique for the numerical solution of certain integral equations of the first kind.Journal of the Association for Computing Machinery, 1962,9, 84–97.Google Scholar
  17. Rao, C. R.Linear statistical inference and its applications. New York: Wiley, 1965.Google Scholar
  18. Riordan, J.An introduction to combinatorial analysis. New York: Wiley, 1958.Google Scholar
  19. Robbins, H. An empirical Bayes approach to statistics.Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability. Berkeley: University of California Press, 1956, vol. 1, pp. 157–163.Google Scholar
  20. Robbins, H. The empirical Bayes approach to testing statistical hypotheses.Review of the International Statistical Institute, 1963,31, (2), 195–208.Google Scholar
  21. Robbins, H. The empirical Bayes approach to statistical decision problems.The Annals of Mathematical Statistics, 1964,35, 1–20.Google Scholar
  22. Skellam, J. G. A probability distribution derived from the binomial distribution by regarding the probability of success as variable between sets of trials.Journal of the Royal Statistical Society, Series B, 1948,10, 257–261.Google Scholar
  23. Tikhonov, A. N. Regularization of incorrectly posed problems.Soviet Mathematics Doklady, 1963,4, 1624–1627.Google Scholar
  24. Tricomi, F. G.Integral equations. New York: Interscience, 1957.Google Scholar
  25. Twomey, S. On the numerical solution of Fredholm integral equations of the first kind by the inversion of the linear system produced by quadrature.Journal of the Association for Computing Machinery, 1963,10, 97–101.Google Scholar
  26. Walsh, J. E. Corrections to two papers concerned with binomial events.Sankhyā, 1963,25, 427.Google Scholar

Copyright information

© Psychometric Society 1969

Authors and Affiliations

  • Frederic M. Lord
    • 1
  1. 1.Educational Testing ServiceUSA

Personalised recommendations