Advertisement

Computerized Classification Tests

  • Cynthia G. Parshall
  • Judith A. Spray
  • John C. Kalohn
  • Tim Davey
Part of the Statistics for Social and Behavioral Sciences book series (SSBS)

Abstract

The computerized classification test (CCT) is the test-delivery method that provides the best approach to making classification decisions. Some testing programs only require a simple dichotomous categorical decision (such as pass/fail) while others may desire or need multicategorical decisions (e.g., high-pass/pass/fail). Computerized classification tests have been primarily used by certification and licensure organizations that credential professionals for employment in specialized areas (e.g., nuclear medicine technologists, registered dietitians, and registered nurses). These applications of CCT are for programs that are considered high stakes in nature, in that the certification or licensure is required for employment or practice and protection of the public. Most high-stakes programs require reasonably good numbers of examinees to support item pool development and maintenance.

Keywords

Item Response Theory Latent Class Model Item Pool Test Length Classification Decision 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.CrossRefGoogle Scholar
  2. Ferguson, R. L. (1969a). Computer-Assisted Criterion-Referenced Measurement (Working Paper No. 41). Pittsburgh: University of Pittsburgh, Learning and Research Development Center. (Eric Document Reproduction Series No. ED 037 089).Google Scholar
  3. Ferguson, R. L. (1969b). The development, implementation, and evaluation of a computer-assisted branched test for a program of individually prescribed instruction. Unpublished doctoral dissertation, University of Pittsburgh. (University Microfilms No. 70-4530).Google Scholar
  4. Glaser, R. (1963). Instructional technology and the measurement of learning outcomes. American Psychologist, 18, 519–521.CrossRefGoogle Scholar
  5. Glaser, R., & Nitko, A. J. (1971). Measurement in learning and instruction. In R. L. Thorndike (ed.), Educational Measurement. Washington, DC: American Council on Education.Google Scholar
  6. Hambleton, R. K., Swaminathan, H., & Algina, J. (1976). Some contributions to the theory and practice of criterion-referenced testing. In DeGruijter, D. N. M., & van der Kamp, L. J. T. (eds.), Advances in Psychology and Educational Measurement (pp. 51–62). New York: John Wiley & Sons.Google Scholar
  7. Hambleton, R. K., Swaminathan, H., Algina, J., & Coulson, D. B. (1978). Criterion-referenced testing and measurement: A review of technical issues and developments. Review of Educational Research, 48, 1–47.Google Scholar
  8. Kalohn, J. C, & Huang, C. (June, 1997). The effect of changing item responses on the accuracy of an SPRT CAT for pass/fail classification decisions. Paper presented at the annual meeting of the Psychometric Society, Gatlinberg, TN.Google Scholar
  9. Kalohn, J.C., & Spray, J. A. (1999). The effect of model misspecifîcation on classifications made using a computerized classification test. Journal of Educational Measurement, 36,46–58.CrossRefGoogle Scholar
  10. Lewis, C, & Sheehan, K. (1990). Using Bayesian decision theory to design a computerized mastery test. Applied Psychological Measurement, 14, 367–386.CrossRefGoogle Scholar
  11. Popham, W. J. (1974) Selecting objectives and generating test items for objectives-based items. In Harris, C. W., & Popham, W. J., (eds.), Problems in Criterion-Referenced Measurement (pp. 13–25). Los Angeles: University of California, Center for the Study of Evaluation.Google Scholar
  12. Reckase, M. D. (1983). A procedure for decision making using tailored testing. In Weiss, D. J., (ed.), New Horizons in Testing: Latent Trait Test Theory and Computerized Adaptive Testing (pp. 237–255). New York: Academic Press.Google Scholar
  13. Safrit, M. J. (1977). Criterion-referenced measurement: Applications in physical education. Motor Skills: Theory into Practice, 2, 21–35.Google Scholar
  14. Sheehan, K., & Lewis, C. (1992). Computerized mastery testing with nonequivalent testlets. Applied Psychological Measurement, 16, 65–76.CrossRefGoogle Scholar
  15. Spray, J. A., & Reckase, M. D. (1996). Comparison of SPRT and sequential Bayes procedures for classifying examinees into two categories using a computerized test. Journal of Educational and Behavioral Statistics, 21, 405–414.Google Scholar
  16. Wald, A. (1947). Sequential Analysis. New York: Wiley.zbMATHGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2002

Authors and Affiliations

  • Cynthia G. Parshall
    • 1
  • Judith A. Spray
    • 2
  • John C. Kalohn
    • 2
  • Tim Davey
    • 3
  1. 1.University of South FloridaTampaUSA
  2. 2.ACT, Inc.Iowa CityUSA
  3. 3.Educational Testing ServicePrincetonUSA

Personalised recommendations