Advertisement

Cognitive Modeling of Individual Responses in Test Design

  • Victor L. Willson
Part of the Perspectives on Individual Differences book series (PIDF)

Abstract

This chapter proposes a model for test design that breaks with classical psychometric traditions, although it is consistent with the general orientation of the general linear model paradigm of representation in social science. The model is based on cognitive theory principles and includes the assumption that any test must be designed formally to consider task structure and information processes. Another assumption is that cognitive theory is fundamentally always representative of each individual, and that there is always the potential for separate, unique individual responses to the test that should be modeled. The following sections of the chapter develop the theses and present both theory and example of such test development.

Keywords

Reading Comprehension Cognitive Modeling Test Design Word Identification Analogical Reasoning 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Adams, M. J. (1990). Beginning to read. Cambridge, MA: MIT Press.Google Scholar
  2. Alexander, P. A. and Judy, J. E. The interaction of domain-specific and strategic knowledge in academic performance. Review of Educational Research, 58, 375–404.Google Scholar
  3. Alexander, P. A., Willson, V. L., White, C. S., & Fuqua, J. D. (1987). Analogical reasoning in young children. Journal of Educational Psychology, 79, 401-408.Google Scholar
  4. Bishop, Y. M. M., Fienberg, S. E., & Holland, P. W. (1975). Discrete multivariate analysis. Cambridge: MIT Press.Google Scholar
  5. Bloom, B., (1956). Taxonomy of educational objectives: Handbook I, Cognitive domain. New York: David McKay.Google Scholar
  6. Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The Dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley.Google Scholar
  7. Embretson, S. E. (1984). A general latent trait model for response process. Psychometrika, 49, 175–186.Google Scholar
  8. Embretson, S. E. (1985). Multicomponent latent trait models for test design. In S. E. Embretson (Ed.), Test design: Developments in psychology and psychometrics (pp. 195–218 ). New York: Academic Press.Google Scholar
  9. Fischer, G. (1973). Linear logistic test model as an instrument in educational research. Acta Psychologica, 37, 359–374.Google Scholar
  10. Fischer, G. (1983). Logistic linear trait models with linear constraints. Psychometrika, 48, 3–26.Google Scholar
  11. Glass, G. V., Willson, V. L., & Gottman, J. (1975). Design and analysis of time-series experiments. Boulder: University of Colorado Press.Google Scholar
  12. Hocking, R. (1985). The analysis of linear models. Monterey, CA: Brooks/Cole Pub. Kaufman, A. S., & Kaufman, N. L. (1983). Kaufman Assessment Battery for Children Interpretive Manuel. Circle Pines, MN: American Guidance Services.Google Scholar
  13. Lord, F., & Novick, M. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.Google Scholar
  14. Mislevy, R. J., & Sheehan, K. M. (1989). The role of collateral information about examinees in item parameter estimation. Psychometrika, 54, 661–679.CrossRefGoogle Scholar
  15. Mulholland, T. M., Pellegrino, J. W., & Glaser, R. (1980). Components of geometric analogy solution. Cognitive Psychology, 12, 252–284.PubMedCrossRefGoogle Scholar
  16. Raven, J. C. (1962). Advanced progressive matrices, sets I and II. London, England: H. K. Lewis and Co., Ltd.Google Scholar
  17. SAS Institute, Inc. (1989). SAS/STAT® User’s Guide, Version 6, Fourth Edition, Volume 1. Cary, NC: SAS Institute, Inc.Google Scholar
  18. Schmidt, A., & Dorans, N. (1990). Differential item functioning for minority examinees on the SAT. Journal of Educational Measurement, 27, 67–81.CrossRefGoogle Scholar
  19. Sternberg, R. J. (1977). Intelligence, information processing, and analogical reasoning: The componential analysis of human abilities. Hillsdale, NJ: Lawrence Erlbaum. Tatsuoka, M. (1988). Multivariate analysis: Techniques for educational and psychological research. New York: Macmillan.Google Scholar
  20. Vygotsky, L. S. (1978). Mind in Society. Cambridge, MA: Harvard University Press. Wagner, R. K., & Sternberg, R. J. (1984). Alternative conceptions of intelligence and their implications for education. Review of Educational Research, 54, 179–223.Google Scholar
  21. Willson, V. L. (1980). Stationary time-series models of true score theory. Paper presented at the annual meeting of the Psychometric Society, Iowa City, May.Google Scholar
  22. Willson, V. L. (1989). Cognitive and developmental effects on item performance in intelligence and achievement tests for young children. Journal of Educational Measurement, 26, 103–119.CrossRefGoogle Scholar
  23. Willson, V. L., Goetz, E. T., Hall, R. J., & Applegate III, E. B. (1986). Effects of varying the number of elements and transformations of matrix analogies on children ages 5–12. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, April.Google Scholar
  24. Willson, V. L., and Olivarez Jr., A. 0. (1987). Information processing of pictorial arithmetic problems. Unpublished manuscript, Texas A and M University, College Station.Google Scholar
  25. Willson, V. L., & Rupley, W. H. (1991). Relationship of reading comprehension to components of word decoding: Support for developmental shifts. Paper presented at the annual meeting of the National Reading Conference, Palm Springs, CA, December.Google Scholar
  26. Zwinderman, A. (1992). A generalized Rasch model for manifest predictors. Psychometrika, 56, 589–600.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 1994

Authors and Affiliations

  • Victor L. Willson
    • 1
  1. 1.Department of Educational PsychologyTexas A&M UniversityCollege StationUSA

Personalised recommendations