The effects of reward structure on student evaluation in a CAI lesson

  • William J. Gibbs
Article

Abstract

THIS STUDY examined the effects of reward structures on the ability of students to evaluate the correctness of their responses to open-ended questions in a Computer-Based Instruction (CBI) lesson. Students’ ability to evaluate responses was influenced, to some extent, by their incentive to achieve. In most instances, the evaluations of expert evaluators and students were found to correspond. However, differences between evaluations occurred when students perceive their responses as correct and evaluators evaluate them as incorrect. It was also found that the order in which the assessment items were presented affected evaluation performance.

Keywords

computer-assisted instruction evaluation computer-based testing constructed responses 

References

  1. Birenbaum, M., & Tatsuoka, K. K. (1987). Open-ended versus multiple-choice response formats: it does make a difference for diagnostic purposes.Applied Psychological Measurement, 11(4), 385–395.CrossRefGoogle Scholar
  2. Boud, D. J., & Falchikov, N. (1989). Quantitative studies of student self-assessment in higher education: A critical analysis of findings.Higher Education, 18(5), 529–549.CrossRefGoogle Scholar
  3. Christensen, K., & Martin, L. (1992). Teaching creative problem solving.The Technology Teacher.9–11.Google Scholar
  4. D’Ignazio, G. (1990). Integrating the works environment of the 1990’s into today’s classroom.T.H.E. Journal.95–96.Google Scholar
  5. Gibbs, W.J., & Peck, K.L. (1995). An Approach to Designing Computer-based evaluation of student constructed responses: Effects on Achievement and Instructional Time.Journal of Computing in Higher Education,6(2), 99–119.CrossRefGoogle Scholar
  6. Jacobson, M.J., & Spiro, R.J. (1994). A framework for the contextual analysis of technology-based learning environments.Journal of Computing in Higher Education, 5(2), 3–32.CrossRefGoogle Scholar
  7. Maqsud, M., & Pillai, C. M. (1991). Effect of self-scoring on subsequent performance in academic achievement test.Educational Research, 33(2), 151–154.Google Scholar
  8. Marrone, J. A. (1990).Learner response to computerized answer judging and its effect on learning and retention.Doctoral dissertation, The Pennsylvania State University.Google Scholar
  9. Pollock, J. C., & Sullivan, H. J. (1990). Practice mode and learner control in computer-based instruction.Contemporary Educational Psychology, 15, 251–260.CrossRefGoogle Scholar
  10. Sanders, M.S., & McCormick, E. J. (1993).Human factors in engineering and design. 7th edition. New York: McGraw-HillGoogle Scholar
  11. Schell, J.W., & Hartman, D.K. (1992). Flexible cognition theory: A framework for advanced vocational learning.Journal of Industrial Teacher Education, 29(3), 39–59.Google Scholar
  12. Schunk, D. (1982). Effects of effort and attributional feedback on children’s perceived self-efficacy and achievement.Journal of Educational Psychology, 74(4), 548–556.CrossRefGoogle Scholar
  13. Spiro, R., & Jehng, J. (1990). Cognitive flexibility and hypertext: Theory and technology for nonlinear and multidimensional traversal of complex subject matter. In D. Nix & R. Spiro (Eds.),Cognition, education, & multimedia: Exploring ideas in high technology (pp. 163–205). Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar
  14. Spiro, R. Vispoel, W. Schmitz, J., Samarapungavan, A., & Boerger, A. (1987). Knowledge acquisition for application: Cognitive flexibility and transfer in complex domains. In B.K. Britton & S.M. Glynn (Eds.),Executive control processes in reading (pp. 177–199). Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar
  15. Wager, W., & Wager, S. (1985). Presenting questions, processing responses, and providing feedback in CAI.Journal of Instructional Development, 8(4), 2–8.CrossRefGoogle Scholar

Copyright information

© Springer 1997

Authors and Affiliations

  • William J. Gibbs
    • 1
  1. 1.Department of Media ServicesEastern Illinois UniversityCharleston

Personalised recommendations