Abstract
Introduction
Methods of teaching and assessment in medical schools have transformed over the recent past. Accreditation of medical schools through national licensing bodies and removal of bias at examinations is the norm. This review is intended to inform senior doctors who are peripherally involved in training at speciality or general professional level.
Materials and methods
From the summative assessment of learning, the uses of assessment for learning and formative assessment have transformed the process of education. Student feedback has moved centre stage. The criteria used to rate questions and abilities are made explicit and there is accountability for student and examiner performances. Standard setting for medical professional examinations is formalised through norm or criteria referencing. Objective methods to determine the pass/fail border including Angoff, Ebel, Nedelsky, Bookmark, Hofstee, borderline group and contrast by group are described. There is some evidence for grade inflation over time at universities. Blueprinting by setting test questions to learning objectives is now standard. The Objective Structured Clinical Examination uses a wide variety of case tasks at different stations. Miller’s pyramid is the road map for professional competence indication where ‘doing’ becomes the benchmark standard. Item response theory and computer adaptive testing are available through the Concerto testing platform which is an open resource.
Conclusion
Examining the performance of examiners as well as that of students is a necessary part of good examination practice. The World Federation for Medical Education with the World Health Organisation has developed nine standards with two categories of basic and quality for the accreditation of medical education.
Similar content being viewed by others
References
Coolahan J (1981) Irish education history and structure. Institute of Public Administration, Dublin
Mansell W (2013) Exam entries—a double-edged sword? The guardian, p 34
Network for Irish Education Standards (2007) Grade inflation: Summary of papers 1–5. http://www.stopgradeinflation.ie. Accessed 24 Aug 2013
http://www.telegraph.co.uk/education/educationnews/10258795/GCSE-results-2013-record-fall-in-top-grades-as-tough-exam-reforms-take-effect.html. Accessed 24 Aug 2013
http://www.dohc.ie/publications/pdf/fottrell.pdf. Accessed 24 Aug 2013
Medical Council. Medical Council rules in respect of the duties of council in relation to medical education and training (section 88 of the Medical Practitioners Act 2007). http://www.medicalcouncil.ie/Education-and-Training/Undergraduate-Medical-Education/. Accessed 24 Aug 2013
General Medical Council (2010) The state of basic medical education, reviewing quality assurance and regulation. http://www.gmc-uk.org/publications/undergraduate_education_publications.asp#stateofbasic. Accessed 24 Aug 2013
http://www.hea.ie/files/SynthesisOfSubmissionsFromHEIstoNationalAcademyconsultation.pdf. Accessed 7 May 2013
http://www.heacademy.ac.uk/professional-recognition. Accessed 25 Aug 2013
http://www.ulster.ac.uk/centrehep/membership.html. Accessed 14 Feb 2014
Report of the Strategy Group. National strategy for higher education to 2030. 14–15. http://WWW.education.ie/en/Publications/Policy-Reports/National-Strategy-for-Higher-Education-2030.pdf. Accessed 14 Feb 2014
Report of the Strategy Group. National strategy for higher education to 2030. 8. http://WWW.education.ie/en/Publications/Policy-Reports/National-Strategy-for-Higher-Education-2030.pdf. Accessed 14 Feb 2014
Third Assessment for Learning Conference Participants (2009) Third international conference on assessment for learning. Dunedin
Klenowski V (2009) Assessment for learning revisited: an Asia-Pacific perspective. Assess Edu Prin Policy Pract 16:263–268
Harlen W, James M (1997) Assessment and learning: differences and relationships between formative and summative assessment. Assess Educ 4:365–379
Black P, Wiliam D (2009) Developing a theory of formative assessment. Educ Assess Eval Account 21:5–31
Swaffield S (2011) Getting to the heart of authentic assessment for learning. Assess Educ Princ Policy Pract 18:433–449
Hargreaves E (2007) The validity of collaborative assessment for learning. Assess Educ 14:185–199
Garvin DA. http://hbsp.harvard.edu/multimedia/pcl/pcl_1/3/threequest.html. Accessed 25 April 2013
Watkins C, Carnell E, Lodge C, Wagner P, Whalley C. Learning about learning enhances performance. NSIN research matters 2001. 13
Frei F. http://hbsp.harvard.edu/multimedia/pcl/pcl_2/2/6learningcollectivelyFF.html. Accessed 25 April 2013
Harden RM, Laidlaw JM (2012) The lecture and teaching with large groups. In: Essential skills for a medical teacher, Chapter 21. Churchill Livingston Elsevier, Edinburgh, pp 131–6
Crosby JR, Hesketh EA (2004) Developing the teaching instinct: 11: small group learning. Med Teach 26:16–19
Goos M, Gannaway D, Hughes C (2011) Assessment as an equity issue in higher education: comparing the perceptions of first year students, course coordinators, and academic leaders. Aust Educ Res 38:95–107
Coates H (2005) The value of student engagement for higher education quality assurance. Qual High Ed 11:25–36
James R, McInnis C, Devlin M (2002) Assessing learning in Australian Universities. Centre for the Study of Higher Education and AUTC, Melbourne
http://www.acer.edu.au/documents/aussereports/AUSSE_2008_Australasia_Uni_Exec_Summary.pdf. Accessed 12 April 2013
Yorke M, Longden B (2008) The first year experience of higher education in the UK. Final report. Higher Education Authority, Heslington
Marginson S, Considine M (2000) The enterprise university: power. Governance and reinvention in Australia. Cambridge University Press, Cambridge
Guidelines for good assessment practice. Compiled by the University of Tasmania Assessment Working Group 2007. University of Tasmania
(2003) World Federation for Medical Education Basic Medical Education WFME Global Standards for Quality Improvement. WFME Office: University of Copenhagen, Denmark
MacCarrick GR (2011) A practical guide to using the World Federation for Medical Education Standards. WFME 3: assessment of students. Ir J Med Sci 180:315–317
Van der Vleuten CP (1996) The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ 1:41–67
Arnett R (2013) Lies damned lies and exam results. 2 setting performance standards quality enhancement office. RCSI Institute of Leadership, Dublin
Cusimano MD (1996) Standard-setting in medical education. Acad Med 71(suppl 10):s112–s120
Greenwood S. Standard setting in the MBChB programme. University of Bristol. http://www.bristol.ac.uk/medical-school/staffstudents/.../standardsetting.pdf. Accessed 27 Aug 2013
Boursicot K, Roberts T. Principles of standard setting. http://www.heacademy.ac.uk/assets/.../51_Principles_of_Standard_Setting.ppt. Accessed 27 Aug 2013
Zieky M, Perie M. A primer on setting cut scores on tests of educational achievement. Educational Testing Service 2006. http://www.ets.org/Media/Research/pdf/Cut_Scores_Primer.pdf. Accessed 28 Aug 2013
Boursicot K, Roberts T (2006) Setting standards in a professional higher education course: defining the concept of the minimally competent student in performance based assessment at the level of graduation from medical school. High Ed Q 60:74–90
Swanson DB, Norman GR, Linn RL (1995) Performance-based assessment: lessons learnt from the health professions. Educ Res 24:5–11
Harden RM, Laidlaw JM (2012) Clinical and performance-based assessment. In: Essential skills for a medical teacher, Chapter 30. Churchill Livingstone Elsevier, pp 195–202
Miller GE (1990) The assessment of clinical skills/competence/performance. Acad Med 65:563–567
http://www.psychometrics.cam.ac.uk/page/338/concerto-testing-platform.htm. Accessed 27 Aug 2013
Birnbaum A (1968) Some latent trait models and their use in inferring an examinee’s ability. Part 5 in FM Lord, MR Novick. 1968 Statistical theories of mental health scores. Addison-Wesley, Reading
Weiss DJ, Kingsbury GG (1984) Application of computerized adaptive testing to educational problems. J Educ Meas 1984(21):361–375
Foy F (2013) The logistics of clinical assessment. RCSI Institute of Leadership Data bank, Dublin
Wass V, Ven der Vieuten C, Shatzer J, Jones R (2001) Assessment of clinical competence. Lancet 357:945–949
O’Neill G, Doyle E, O’Boyle K, Clipson N. Choice of assessment methods within a module: students’ experiences and staff recommendations for practice. AISHE 2010. http://ocs.aoshe.org/aishe/index/.php/international/2010/paper/paper/view/155
Conflict of interest
There are no conflicts of interest.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tormey, W. Education, learning and assessment: current trends and best practice for medical educators. Ir J Med Sci 184, 1–12 (2015). https://doi.org/10.1007/s11845-014-1069-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11845-014-1069-4