Advertisement

Psychometrika

, Volume 10, Issue 4, pp 255–282 | Cite as

A basis for analyzing test-retest reliability

  • Louis Guttman
Article

Abstract

Three sources of variation in experimental results for a test are distinguished: trials, persons, and items. Unreliability is defined only in terms of variation over trials. This definition leads to a more complete analysis than does the conventional one; Spearman's contention is verified that the conventional approach—which was formulated by Yule—introduces unnecessary hypotheses. It is emphasized that at least two trials are necessary to estimate the reliability coefficient. This paper is devoted largely to developinglower bounds to the reliability coefficient that can be computed from but asingle trial; these avoid the experimental difficulties of making two independent trials. Six different lower bounds are established, appropriate for different situations. Some of the bounds are easier to compute than are conventional formulas, and all the bounds assume less than do conventional formulas. The terminology used is that of psychological and sociological testing, but the discussion actually provides a general analysis of the reliability of the sum ofn variables.

Keywords

Lower Bound Public Policy Statistical Theory General Analysis Conventional Approach 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Guilford, J. P. Psychometric methods. New York: McGraw-Hill, 1936.Google Scholar
  2. 2.
    Guttman, Louis. A basis for scaling qualitative data.American Sociological Review, 1944,9, 139–150.Google Scholar
  3. 3.
    Guttman, Louis. Multiple rectilinear prediction and the resolution into components.Psychometrika, 1940,5, 75–99.Google Scholar
  4. 4.
    Hoyt, Cyril. Test reliability estimated by analysis of variance.Psychometrika, 1941,6, 153–160.Google Scholar
  5. 5.
    Kuder, G. F., and Richardson, M. W. The theory of the estimation of test reliability.Psychometrika, 1937,2, 151–160.Google Scholar
  6. 6.
    Spearman, Charles. The proof and measurement of association between two things.American Journal of Psychology, 1904,15, 72–101.Google Scholar
  7. 7.
    Spearman, Charles. Correlation calculated from faulty data.British Journal of Psychology, 1910,3, 271–295.Google Scholar

Copyright information

© Psychometric Society 1945

Authors and Affiliations

  • Louis Guttman
    • 1
  1. 1.Department of Sociology and AnthropologyCornell UniversityUSA

Personalised recommendations