Educational Psychology Review

, Volume 11, Issue 4, pp 411–427 | Cite as

Operational Definitions and Assessment of Higher-Order Cognitive Constructs

  • Robert L. Williams


The educational psychology literature is replete with references to higher-order cognitive constructs, such as critical thinking and creativity. Presumably, these constructs represent the primary processes and outcomes that educators should promote in students. For these constructs to be maximally useful, they must be transformed into specific operational definitions that lead to reliable and valid assessment strategies. Minimizing overlap in the definitions and assessment of different concepts would contribute to an orderly accumulation of knowledge about the constructs in question. The ideal would be for each construct to have a definition that is distinct from the definitions of other cognitive constructs. Although higher-order cognitive constructs have much surface appeal, their utility is tied to the clarity and fidelity of their definitions and assessment procedures.

operational definitions cognitive constructs assessment critical thinking creativity 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Amabile, T. M. (1987). The motivation to be creative. In Isaksen, S. G. (ed.), Frontiers of Creativity Research: Beyond the Basics, Bearly, Buffalo, NY, pp. 223-254.Google Scholar
  2. Anastasi, A. (1976). Psychological Testing, 4th ed., Macmillan, New York.Google Scholar
  3. Baer, J. (1991). Generality of creativity across performance domains. Creativ. Res. J. 4: 23-39.Google Scholar
  4. Baer, J. (1993a). Divergent Thinking and Creativity: A Task-Specific Approach, Lawrence Erlbaum Associates, Hillsdale, NJ.Google Scholar
  5. Baer, J. (1993b). Performance assessments of creativity: Do they have long-term stability? Roeper Rev. 17(1): 7-19.Google Scholar
  6. Baker, J. E., and Winston, A. S. (1985). Modifying children's creative drawing: Experimental analysis and social validation of a self-instructional procedure. Educ. Treat. Children 8: 115-132.Google Scholar
  7. Brabeck, N. M. (1983). Critical thinking skills and reflective judgment development: Redefining the aims of higher education. J. Appl. Dev. Psychol. 4: 23-34.Google Scholar
  8. Campbell, J. A., and Willis, J. (1978). Modifying components of "creative behavior" in the natural environment. Behav. Modif. 2: 549-564.Google Scholar
  9. Campbell, J. A., and Willis, J. (1979). A behavioral program to teach creative writing in the regular classroom. Educ. Treat. Children 2: 5-15.Google Scholar
  10. Cooper, E. (1991). A critique of six measures for assessing creativity. J. Creat. Behav. 25: 194-204.Google Scholar
  11. Dewey, J. (1916). Democracy and Education, Macmillan, New York.Google Scholar
  12. Ennis, R. H. (1993). Critical thinking assessment. Theory Pract. 32: 179-186.Google Scholar
  13. Ennis, R. H., and Weir, E. (1985). The Ennis-Weir Critical Thinking Essay Test, Midwest, Pacific Grove, CA.Google Scholar
  14. Facione, P. A. (1986). Critical thinking assessment. Theory Practice 32: 179-186.Google Scholar
  15. Facione, P. A. (1990). Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction, Research Findings and Recommendations, American Philosophical Association (ERIC Document Reproduction Service No. ED 315 423), Newark, DE.Google Scholar
  16. Facione, P. A., and Facione, N. C. (1994). The California Critical Thinking Skills Test, California Academic Press, Millbrae.Google Scholar
  17. Ford, D. V., and Harris, J. J. (1992). The elusive definition of creativity. J. Creat. Behav. 26: 186-198.Google Scholar
  18. Glover, J. A. (1979). The effectiveness of reinforcement and practice for enhancing the creative writing of elementary school children. J. Appl. Behav. Anal. 12: 487.Google Scholar
  19. Glover, J. A., and Gary, A. L. (1976). Procedures to increase some aspects of creativity. J. Appl. Behav. Anal. 9: 79-84.Google Scholar
  20. Glover, J., and Ronning, R. (1987). Introduction. In Glover, J., and Ronning, R. (eds.), Historical Foundations of Educational Psychology, Plenum Press, New York, pp. 3-15.Google Scholar
  21. Glover, J. A., Zimmer, J. W., and Bruning, R. H. (1980). Information processing approaches among creative students. The J. Psychol. 105: 93-97.Google Scholar
  22. Goetz, E. A. (1982). A review of functional analyses of preschool children's creative behaviors. Educ. Treat. Children 5: 157-177.Google Scholar
  23. Goggin, H. B., Landers, W. F., and Bittner, A. C. (1978). Concepts of equivalence relations and conservation of liquid in preschool children. Psychol. Rep. 43: 991-1001.Google Scholar
  24. Guilford, J. P. (1950). Creativity. Am. Psychol. 5: 444-454.Google Scholar
  25. Halpern, D. F. (1993). Assessing the effectiveness of critical thinking instruction. J. Gen. Educ. 42: 238-254.Google Scholar
  26. Halpern, D. F. (1998). Teaching critical thinking for transfer across domains. Am. Psychol. 53: 449-455.Google Scholar
  27. Hamers, J. H. M., de Koning, E., and Sijtsma, K. (1998). Inductive reasoning in third grade: Intervention promises and constraints. Contemp. Educ. Psychol. 23: 132-148.Google Scholar
  28. Kazdin, A. E. (1994). Behavior Modification in Applied Settings, Brooks/Cole, Pacific Grove, CA.Google Scholar
  29. Kiah, C. J. (1993). A model for assessing critical thinking skills. Paper presented at the meeting of the Annual Student Assessment Conference of the Virginia Assessment Group and the State Council of Higher Education for Virginia, Richmond, Nov.Google Scholar
  30. Maloney, K. B., and Hopkins, B. L. (1973). The modification of sentence structure and its relationship to subjective judgements of creativity in writing. J. Appl. Behav. Anal. 6: 425-433.Google Scholar
  31. Mansfield, R. S., and Busse, T. V. (1981). The Psychology of Creativity and Discovery, Nelson-Hall, Chicago.Google Scholar
  32. Mansfield, R. S., Busse, T. V., and Krepelka, E. J. (1978). The effectiveness of creativity training. Rev. Educ. Res. 48: 517-536.Google Scholar
  33. Ochse, R. (1990). Before the Gates of Excellence. The Determination of Creative Genius, Cambridge University Press, Cambridge.Google Scholar
  34. Sager, E. (1976). Operational definition. J. Bus. Commun. 14(1): 23-26.Google Scholar
  35. Sternberg, R. J., and Lubart, T. I. (1996). Investing in creativity. Am. Psychol. 51: 677-688.Google Scholar
  36. Torrance, E. P. (1966). Torrance Tests of Creative Thinking: Norms 3-Technical Manual, Personnel, Lexington, MA.Google Scholar
  37. Torrance, E. P. (1974a). Torrance Tests of Creative Thinking: Directions Manual and Scoring Guide, Scholastic Testing Service, Bensenville, IL.Google Scholar
  38. Torrance, E. P. (1974b). Torrance Tests of Creative Thinking. Norms 3-Technical Manual, Scholastic Testing Service, Bensenville, IL.Google Scholar
  39. Treffinger, D. J. (1985). Review of the Torrance tests of creative thinking. In Mitchell, J. V. Jr. (ed.), The Ninth Mental Measurements Yearbook, University of Nebraska, Lincoln, pp. 1632-1634.Google Scholar
  40. Walberg, H., and Haertel, G. (1992). Educational psychology's first century. J. Educ. Psychol. 84: 6-19.Google Scholar
  41. Wallach, L. (1971). Implications of recent work in philosophy of science for the role of operational definition in psychology. Psychol. Rep. 28: 583-608.Google Scholar
  42. Watson, G., and Glaser, E. (1980). Watson-Glaser Critical Thinking Appraisal, Psychological Corporation, San Antonio, TX.Google Scholar
  43. Worthen, B. R. (1993). Critical issues that will determine the future of alternative assessment. Phi Delta Kappan 74: 444-454.Google Scholar

Copyright information

© Plenum Publishing Corporation 1999

Authors and Affiliations

  • Robert L. Williams
    • 1
  1. 1.Psychoeducational StudiesThe University of TennesseeKnoxvilleTennessee

Personalised recommendations