Skip to main content
Log in

A basis for analyzing test-retest reliability

  • Published:
Psychometrika Aims and scope Submit manuscript

Abstract

Three sources of variation in experimental results for a test are distinguished: trials, persons, and items. Unreliability is defined only in terms of variation over trials. This definition leads to a more complete analysis than does the conventional one; Spearman's contention is verified that the conventional approach—which was formulated by Yule—introduces unnecessary hypotheses. It is emphasized that at least two trials are necessary to estimate the reliability coefficient. This paper is devoted largely to developinglower bounds to the reliability coefficient that can be computed from but asingle trial; these avoid the experimental difficulties of making two independent trials. Six different lower bounds are established, appropriate for different situations. Some of the bounds are easier to compute than are conventional formulas, and all the bounds assume less than do conventional formulas. The terminology used is that of psychological and sociological testing, but the discussion actually provides a general analysis of the reliability of the sum ofn variables.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Guilford, J. P. Psychometric methods. New York: McGraw-Hill, 1936.

    Google Scholar 

  2. Guttman, Louis. A basis for scaling qualitative data.American Sociological Review, 1944,9, 139–150.

    Google Scholar 

  3. Guttman, Louis. Multiple rectilinear prediction and the resolution into components.Psychometrika, 1940,5, 75–99.

    Google Scholar 

  4. Hoyt, Cyril. Test reliability estimated by analysis of variance.Psychometrika, 1941,6, 153–160.

    Google Scholar 

  5. Kuder, G. F., and Richardson, M. W. The theory of the estimation of test reliability.Psychometrika, 1937,2, 151–160.

    Google Scholar 

  6. Spearman, Charles. The proof and measurement of association between two things.American Journal of Psychology, 1904,15, 72–101.

    Google Scholar 

  7. Spearman, Charles. Correlation calculated from faulty data.British Journal of Psychology, 1910,3, 271–295.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

The writer is indebted to the members of his statistical seminar, to Professor Mark Kac, and to Professor Samuel A. Stouffer and his staff in the Research Branch, Information and Education Division, War Department, for their helpful comments on this paper.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Guttman, L. A basis for analyzing test-retest reliability. Psychometrika 10, 255–282 (1945). https://doi.org/10.1007/BF02288892

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02288892

Keywords

Navigation