Skip to main content
SpringerLink
Log in

Innovative Online Assessment Using Confidence Measurement

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

This research investigates and evaluates an innovative approach to a web based formative assessment system. This self assessment tool is based on the traditional Multiple Choice Questions with additional facilitation of registering the level of confidence of the student's response to each of the options available. The student's generated score is designed to reflect their understanding of the topic under review.

A series of experiments involving 93 participating students and 8 instructors were conducted producing some interesting qualitative and quantitative data. Our results show that it appears that this tool has promise as a positive contributor to the instructor and student as they journey along their learning path. In addition this research recommends directions for further studies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Black, P. and William, D. (1998) Assessment and classroom. Learning Assessment in Education, 5, March, 7–74.

    Google Scholar 

  • Black, P. and William, D. (1998) Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 80(2), October, 139–149; http://www.pdkintl.org/kappan/kbla9810.htm

    Google Scholar 

  • Brown, T. A. and Shuford, E. H. (1973) Quantifying uncertainty into numerical probabilities for the reporting of intelligence. Defence Advanced Research Projects Agency Report R-1185-ARPA. Rand Corp, Santa Monica, CA.

    Google Scholar 

  • Davidoff, F. (1995) Confidence testing-how to answer a meta-question. American College of Physicians Observer; http://www.acponline.org/journals/news/feb95/conftest.htm

  • web_tools.htm

  • Diamond, G. A. and Forrester, J. S. (1983) An epistemologic model of clinical judgment. Am. J. Med., 75, 129–137.

    Google Scholar 

  • Doebbert, J. (1999) Benchmarking the Learning Environment (Technology). National Centre of Research in Vocational Education, Copa & Ammentorp Press, Ch. 5; http://vocserve.berkeley.edu/abstracts/MDS-1108/MDS-1108-CHAPTER-5.html

  • Frary, R. (1995) More multiple choise item writing do's and don'ts. Practical Assessment and Evaluation, ERIC Clearinghouse on Assessment and Evaluation, 4(11); http://ericae.net/pare/getvn.asp?v=4&n=9

  • Jamieson, R. (1999) An Investigation of auditor decision-making in an information systems audit domain. Unpublished Ph.D. Dissertation, University of New South Wales.

  • Kehoe, J. (1995) Writing multiple choice test questions. Practical Assessment, Assessment and Evaluation, ERIC Clearinghouse on Assessment and Evaluation, 4(9); http://ericae.net/pare/getvn.asp?v=4&n=9

  • Klinger, A. (1997) Experimental validation of learning accomplishment. Technical Report No. 970019, Frontiers in Education.

  • Krumboltz, J. and Christine, J. (1999) Point of view, competitive grading sabotages good teaching. Phi Delta Kappan, 324.

  • Marshal University (1999) Comparison of online course delivery software products; http://multimedia.marshall. edu/cit/webct/compare/comparison.html

  • Paul, J. (1994) Improving education through computer based alternative assessment methods. People and Computers, 9.

  • Perrenoud, P. (1991) Towards a pragmatic approach to formative evaluation. Assessment of Pupils' Achievement: Motivation and School Success. Swets and Zeitlinger, Amsterdam, p. 92.

    Google Scholar 

  • Pollard, G. (1985) Scoring in multiple choice examinations. Math. Scientists, 10, 93–97.

    Google Scholar 

  • Pollard, G. (1986) Scoring to remove guessing in multiple choice exams. Math. Education Science Technology, 20(2), 33–36.

    Google Scholar 

  • Pollard, G. and Clark, D. (1989) An optimal scoring system of multiple choice competitions and an analysis of candidates responses under two different methods of scoring. Mathematics Competitions, 2(2), 33–36.

    Google Scholar 

  • Pollard, G. (1993) Further scoring systems to remove guessing in multiple choice examinations. Mathematics Competitions, 2(1), 27–43.

    Google Scholar 

  • Principles and Standards for School Mathematics (2000) National Council of Teachers of Mathematics-Standards 2000 Project, Ch. 2.

Download references

Author information

Authors and Affiliations

  1. School of Information Technology, Swinburne University of Technology, John St, Hawthorn 3122, Melbourne, Victoria, Australia

    Graham Farrell

  2. Department of Information & Communications Technology, Hong Kong Institute of Vocational Education, New Territories, Hong Kong

    Ying K. Leung

Authors
  1. Graham Farrell
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ying K. Leung
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Farrell, G., Leung, Y.K. Innovative Online Assessment Using Confidence Measurement. Education and Information Technologies 9, 5–19 (2004). https://doi.org/10.1023/B:EAIT.0000024258.29560.3c

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:EAIT.0000024258.29560.3c

Search

Navigation