Skip to main content

Appropriate Use of Technology: How Useful Are Calculations of Discrimination Index by Optical Mark Readers in Item Analysis of Single Best Answer MCQ Tests with Small Student Numbers?

  • Conference paper
  • First Online:
Redesigning Learning for Greater Social Impact

Abstract

Recent advances in computer-related technology and the availability of technology to everyone at affordable cost have made it possible to use such technology in every aspect of teaching-learning. Educational institutions are increasingly using optical mark readers (OMRs) which also feature software that calculates difficulty index and discrimination index in addition to correcting hundreds of OMR mark sheets in a matter of seconds to minutes which would otherwise take many man-hours. We explore how useful the calculations of discrimination index by optical mark readers are in item analysis of single best answer MCQ tests with small student numbers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Amo-Salas, M., Arroyo-Jimenez, MDM., Bustos-Escribano, D., Fairén-Jiménez, E., López-Fidalgo, J. (2014). New Indices for Refining Multiple Choice Questions. Journal of Probability and Statistics 2014, 8 (Article ID 240263). doi:10.1155/2014/240263. Available at http://www.hindawi.com/journals/jps/2014/240263/ Accessed May 30, 2016.

  • Beuchert, A. K., & Mendoza, J. L. (1979). A Monte Carlo comparison of ten item discrimination indices. Journal of Educational Measurement, 16, 109–117.

    Article  Google Scholar 

  • Englehart, M. D. (1965). A comparison of several item discrimination indices. Educational and Psychological Measurement, 2, 69–76.

    Google Scholar 

  • Hassan, S., Amin, R. M., Rebuan, H. M. A., & Aung, M. M. T. (2016). Item analysis, reliability statistics and standard error of measurement to improve the quality and impact of multiple choice questions in undergraduate medical education in faculty of medicine at UNISZA. Malaysian Journal of Public Health Medicine, 16(3), 7–15.

    Google Scholar 

  • Kelley, T. L. (1939). The selection of upper and lower groups for the validation of test items. Journal of Educational Psychology, 30, 17–24.

    Article  Google Scholar 

  • Liu F, (under supervision of Kim S-H, Olejnik S, Templin J). (2008). Comparison of several popular discrimination indices based on different criteria and their application in item analysis. Thesis for Master of Arts, University of Georgia. Available at: https://getd.libs.uga.edu/pdfs/liu_fu_200808_ma.pdf Accessed June 15, 2016.

  • Matlock-Hetzel S. (1997). Basic concepts in test and item analysis. Texas A&M University, January 1997. Available at: http://ericae.net/ft/tamu/Espy.htm Accessed June 15, 2016.

  • Novick, M.R. (1966). The axioms and principal results of classical test theory. Journal of Mathematical Psychology 3(1), 1–18.

    Google Scholar 

  • Nunnally, J. C. (1972). Educational measurement and evaluation (2nd ed.). New York: McGraw-Hill.

    Google Scholar 

  • Pareek, U. (2007). Item analysis. In Training instruments in HRD and OD (2nd ed., pp. 34–35). New Delhi: Tata-McGraw-Hill.

    Google Scholar 

  • Popham, W. J. (1981). Modern educational measurement. Englewood Cliff, NJ: Prentice-Hall.

    Google Scholar 

  • Professional Testing Inc. (2006). Criterion-referenced tests (CRTs) and Norm-referenced tests (NRTs) in Test Topics. Available at: http://www.proftesting.com/test_topics/test_types_CRT.php. Accessed May 30, 2016.

  • Shannon, G. A., & Cliver, B. A. (1987). An application of item response theory in the comparison of four conventional item discrimination indices for criterion-referenced tests. Journal of Educational Measurement, 24(4), 347–356. doi:10.1111/j.1745-3984.1987.tb00285.x

    Article  Google Scholar 

  • Wiersma, W., & Jurs, S. G. (1990). Educational measurement and testing (2nd ed.). Boston, MA: Allyn and Bacon.

    Google Scholar 

  • Zaiontz, C. (2016). Item analysis basic concepts. Available at: http://www.real-statistics.com/reliability/item-analysis/item-analysis-basic-concepts/ Accessed June 15, 2016.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Benjamin Samraj Prakash Earnest .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Earnest, B.S.P., Bhargava, P., Ponnupillai, A., Ponnusamy, S., Ibrahim, N.M., Sirisinghe, R.G. (2018). Appropriate Use of Technology: How Useful Are Calculations of Discrimination Index by Optical Mark Readers in Item Analysis of Single Best Answer MCQ Tests with Small Student Numbers?. In: Tang, S., Cheah, S. (eds) Redesigning Learning for Greater Social Impact. Springer, Singapore. https://doi.org/10.1007/978-981-10-4223-2_25

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-4223-2_25

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-4222-5

  • Online ISBN: 978-981-10-4223-2

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics