Are multiple choice tests fair to medical students with specific learning disabilities?
- 815 Downloads
The purpose of multiple choice tests of medical knowledge is to estimate as accurately as possible a candidate’s level of knowledge. However, concern is sometimes expressed that multiple choice tests may also discriminate in undesirable and irrelevant ways, such as between minority ethnic groups or by sex of candidates. There is little literature to establish whether multiple choice tests may also discriminate against students with specific learning disabilities (SLDs), in particular those with a diagnosis of dyslexia, and whether the commonly-used accommodations allow such students to perform up to their capability. We looked for evidence to help us determine whether multiple choice tests could be relied upon to test all medical students fairly, regardless of disability. We analyzed the mean scores of over 900 undergraduate medical students on eight multiple-choice progress tests containing 1,000 items using a repeated-measures analysis of variance. We included disability, gender and ethnicity as possible explanatory factors, as well as year group. There was no significant difference between mean scores of students with an SLD who had test accommodations and students with no SLD and no test accommodation. Virtually all students were able to complete the tests within the allowed time. There were no significant differences between the mean scores of known minority ethnic groups or between the genders. We conclude that properly-designed multiple-choice tests of medical knowledge do not systematically discriminate against medical students with specific learning disabilities.
KeywordsLearning disabilities Dyslexia Assessment Undergraduate medical education Bias Education measurement
- American Educational Research Association, American Psychological Association, National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington: American Educational Research Association.Google Scholar
- BMA Equal Opportunities Committee. (2007). Disability equality in the medical profession. London: British Medical Association.Google Scholar
- BMA Medical Students’ Committee. (2006). Studying medicine with dyslexia [electronic version]. London: British Medical Association. Retrieved 25 February, 2009 from www.bma.org.uk/ap.nsf/content/dyslexia.
- Case, S. M., & Swanson, D. B. (2003). Constructing written test questions for the basic and clinical sciences (3rd ed.) [electronic version]. Philadelphia: National Board of Medical Examiners. Retrieved 21 February, 2009 from http://www.nbme.org/PDF/ItemWriting_2003/2003IWGwhole.pdf.
- Cole, N. (1997). The ETS gender study: How females and males perform in educational settings [electronic version]. ETS technical report. Retrieved 16 July, 2009 from http://eric.ed.gov/ERICDocs/data/ericdocs2sql/content_storage_01/0000019b/80/16/fb/56.pdf.
- DeLisa, J. A. (2006). Physicians with disabilities: Why aren’t there more of them? [online article]. Washington, DC: AAMC Reporter (February). Retrieved from http://www.aamc.org/newsroom/reporter/feb06/viewpoint.htm.
- Gipps, C., & Murphy, P. (1994). A fair test? Assessment, achievement and equity. Buckingham: Open University Press. ISBN 0335156738.Google Scholar
- Leinster, S., & Gibson, S. (2008). Dyslexia: A real or perceived problem in medical assessments. Poster presented at the 13th Ottawa international conference on clinical competence, Melbourne. Retrieved 21 February, 2009 from http://www.ozzawa13.com/conferenceabstracts.php, p. 651.
- McKendree, J. (2001). I have heard that negative marking of multiple-choice questions (MCQs) can have undesirable results. What is the research on this? [online article]. Newcastle upon Tyne: Higher Education Academy Medicine, Dentistry and Veterinary Medicine Subject Centre. Retrieved 12 February, 2009 from http://www.medev.ac.uk/resources/faq/display_single?autonum=24.
- McKendree, J. (2002). Negative marking & gender bias. CAA Centre Website. Retrieved 25 February, 2009 from http://www.caacentre.ac.uk/resources/faqs/negative_marking1.shtml.
- Medical Schools Council. (2005). Recommendations on selection of medical students with specific learning disabilities including dyslexia [electronic version]. London: Medical Schools Council. Retrieved 25 February, 2009 from http://www.chms.ac.uk/publications.htm#publications.
- Palmer, E. J., & Devitt, P. G. (2007). Assessment of higher order cognitive skills in undergraduate education: Modified essay or multiple choice questions? BMC Medical Education, 7, 49. Retrieved 16 February, 2009 from http://www.biomedcentral.com/1472-6920/7/49.
- Specific Learning Disabilities Working Group. (2005). Assessment of dyslexia, dyspraxia, dyscalculia and attention deficit disorder (ADD) in higher education. London: DfES.Google Scholar
- Waterfield, J., & West, B. (2006). Inclusive assessment in higher education: A resource for change [electronic version]. Retrieved 25 February, 2009 from University of Plymouth website http://www.plymouth.ac.uk/pages/view.asp?page=10494.