Psychometrika

, Volume 57, Issue 2, pp 217–236

Ordinal test fidelity estimated by an item sampling model

  • Norman Cliff
  • John R. Donoghue
Article

DOI: 10.1007/BF02294506

Cite this article as:
Cliff, N. & Donoghue, J.R. Psychometrika (1992) 57: 217. doi:10.1007/BF02294506

Abstract

A test theory using only ordinal assumptions is presented. It is based on the idea that the test items are a sample from a universe of items. The sum across items of the ordinal relations for a pair of persons on the universe items is analogous to a true score. Using concepts from ordinal multiple regression, it is possible to estimate the tau correlations of test items with the universe order from the taus among the test items. These in turn permit the estimation of the tau of total score with the universe. It is also possible to estimate the odds that the direction of a given observed score difference is the same as that of the true score difference. The estimates of the correlations between items and universe and between total score and universe are found to agree well with the actual values in both real and artificial data.

Key words

test theoryitem samplingordinal methodsitem universe

Copyright information

© The Psychometric Society 1992

Authors and Affiliations

  • Norman Cliff
    • 1
  • John R. Donoghue
    • 2
  1. 1.Department of Psychology, MC-1061University of Southern CaliforniaLos Angeles
  2. 2.Educational Testing ServiceUSA