Skip to main content

Advertisement

Log in

Education, learning and assessment: current trends and best practice for medical educators

  • Review Article
  • Published:
Irish Journal of Medical Science (1971 -) Aims and scope Submit manuscript

Abstract

Introduction

Methods of teaching and assessment in medical schools have transformed over the recent past. Accreditation of medical schools through national licensing bodies and removal of bias at examinations is the norm. This review is intended to inform senior doctors who are peripherally involved in training at speciality or general professional level.

Materials and methods

From the summative assessment of learning, the uses of assessment for learning and formative assessment have transformed the process of education. Student feedback has moved centre stage. The criteria used to rate questions and abilities are made explicit and there is accountability for student and examiner performances. Standard setting for medical professional examinations is formalised through norm or criteria referencing. Objective methods to determine the pass/fail border including Angoff, Ebel, Nedelsky, Bookmark, Hofstee, borderline group and contrast by group are described. There is some evidence for grade inflation over time at universities. Blueprinting by setting test questions to learning objectives is now standard. The Objective Structured Clinical Examination uses a wide variety of case tasks at different stations. Miller’s pyramid is the road map for professional competence indication where ‘doing’ becomes the benchmark standard. Item response theory and computer adaptive testing are available through the Concerto testing platform which is an open resource.

Conclusion

Examining the performance of examiners as well as that of students is a necessary part of good examination practice. The World Federation for Medical Education with the World Health Organisation has developed nine standards with two categories of basic and quality for the accreditation of medical education.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Coolahan J (1981) Irish education history and structure. Institute of Public Administration, Dublin

    Google Scholar 

  2. Mansell W (2013) Exam entries—a double-edged sword? The guardian, p 34

  3. Network for Irish Education Standards (2007) Grade inflation: Summary of papers 1–5. http://www.stopgradeinflation.ie. Accessed 24 Aug 2013

  4. http://www.telegraph.co.uk/education/educationnews/10258795/GCSE-results-2013-record-fall-in-top-grades-as-tough-exam-reforms-take-effect.html. Accessed 24 Aug 2013

  5. http://www.dohc.ie/publications/pdf/fottrell.pdf. Accessed 24 Aug 2013

  6. Medical Council. Medical Council rules in respect of the duties of council in relation to medical education and training (section 88 of the Medical Practitioners Act 2007). http://www.medicalcouncil.ie/Education-and-Training/Undergraduate-Medical-Education/. Accessed 24 Aug 2013

  7. General Medical Council (2010) The state of basic medical education, reviewing quality assurance and regulation. http://www.gmc-uk.org/publications/undergraduate_education_publications.asp#stateofbasic. Accessed 24 Aug 2013

  8. http://www.hea.ie/files/SynthesisOfSubmissionsFromHEIstoNationalAcademyconsultation.pdf. Accessed 7 May 2013

  9. http://www.heacademy.ac.uk/professional-recognition. Accessed 25 Aug 2013

  10. http://www.ulster.ac.uk/centrehep/membership.html. Accessed 14 Feb 2014

  11. Report of the Strategy Group. National strategy for higher education to 2030. 14–15. http://WWW.education.ie/en/Publications/Policy-Reports/National-Strategy-for-Higher-Education-2030.pdf. Accessed 14 Feb 2014

  12. Report of the Strategy Group. National strategy for higher education to 2030. 8. http://WWW.education.ie/en/Publications/Policy-Reports/National-Strategy-for-Higher-Education-2030.pdf. Accessed 14 Feb 2014

  13. Third Assessment for Learning Conference Participants (2009) Third international conference on assessment for learning. Dunedin

  14. Klenowski V (2009) Assessment for learning revisited: an Asia-Pacific perspective. Assess Edu Prin Policy Pract 16:263–268

    Google Scholar 

  15. Harlen W, James M (1997) Assessment and learning: differences and relationships between formative and summative assessment. Assess Educ 4:365–379

    Article  Google Scholar 

  16. Black P, Wiliam D (2009) Developing a theory of formative assessment. Educ Assess Eval Account 21:5–31

    Article  Google Scholar 

  17. Swaffield S (2011) Getting to the heart of authentic assessment for learning. Assess Educ Princ Policy Pract 18:433–449

    Article  Google Scholar 

  18. Hargreaves E (2007) The validity of collaborative assessment for learning. Assess Educ 14:185–199

    Article  Google Scholar 

  19. Garvin DA. http://hbsp.harvard.edu/multimedia/pcl/pcl_1/3/threequest.html. Accessed 25 April 2013

  20. Watkins C, Carnell E, Lodge C, Wagner P, Whalley C. Learning about learning enhances performance. NSIN research matters 2001. 13

  21. Frei F. http://hbsp.harvard.edu/multimedia/pcl/pcl_2/2/6learningcollectivelyFF.html. Accessed 25 April 2013

  22. Harden RM, Laidlaw JM (2012) The lecture and teaching with large groups. In: Essential skills for a medical teacher, Chapter 21. Churchill Livingston Elsevier, Edinburgh, pp 131–6

  23. Crosby JR, Hesketh EA (2004) Developing the teaching instinct: 11: small group learning. Med Teach 26:16–19

    Article  CAS  PubMed  Google Scholar 

  24. Goos M, Gannaway D, Hughes C (2011) Assessment as an equity issue in higher education: comparing the perceptions of first year students, course coordinators, and academic leaders. Aust Educ Res 38:95–107

    Article  Google Scholar 

  25. Coates H (2005) The value of student engagement for higher education quality assurance. Qual High Ed 11:25–36

    Article  Google Scholar 

  26. James R, McInnis C, Devlin M (2002) Assessing learning in Australian Universities. Centre for the Study of Higher Education and AUTC, Melbourne

    Google Scholar 

  27. http://www.acer.edu.au/documents/aussereports/AUSSE_2008_Australasia_Uni_Exec_Summary.pdf. Accessed 12 April 2013

  28. Yorke M, Longden B (2008) The first year experience of higher education in the UK. Final report. Higher Education Authority, Heslington

    Google Scholar 

  29. Marginson S, Considine M (2000) The enterprise university: power. Governance and reinvention in Australia. Cambridge University Press, Cambridge

    Google Scholar 

  30. Guidelines for good assessment practice. Compiled by the University of Tasmania Assessment Working Group 2007. University of Tasmania

  31. (2003) World Federation for Medical Education Basic Medical Education WFME Global Standards for Quality Improvement. WFME Office: University of Copenhagen, Denmark

  32. MacCarrick GR (2011) A practical guide to using the World Federation for Medical Education Standards. WFME 3: assessment of students. Ir J Med Sci 180:315–317

    Article  CAS  PubMed  Google Scholar 

  33. Van der Vleuten CP (1996) The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ 1:41–67

    Article  Google Scholar 

  34. Arnett R (2013) Lies damned lies and exam results. 2 setting performance standards quality enhancement office. RCSI Institute of Leadership, Dublin

    Google Scholar 

  35. Cusimano MD (1996) Standard-setting in medical education. Acad Med 71(suppl 10):s112–s120

    Article  CAS  PubMed  Google Scholar 

  36. Greenwood S. Standard setting in the MBChB programme. University of Bristol. http://www.bristol.ac.uk/medical-school/staffstudents/.../standardsetting.pdf. Accessed 27 Aug 2013

  37. Boursicot K, Roberts T. Principles of standard setting. http://www.heacademy.ac.uk/assets/.../51_Principles_of_Standard_Setting.ppt. Accessed 27 Aug 2013

  38. Zieky M, Perie M. A primer on setting cut scores on tests of educational achievement. Educational Testing Service 2006. http://www.ets.org/Media/Research/pdf/Cut_Scores_Primer.pdf. Accessed 28 Aug 2013

  39. Boursicot K, Roberts T (2006) Setting standards in a professional higher education course: defining the concept of the minimally competent student in performance based assessment at the level of graduation from medical school. High Ed Q 60:74–90

    Article  Google Scholar 

  40. Swanson DB, Norman GR, Linn RL (1995) Performance-based assessment: lessons learnt from the health professions. Educ Res 24:5–11

    Article  Google Scholar 

  41. Harden RM, Laidlaw JM (2012) Clinical and performance-based assessment. In: Essential skills for a medical teacher, Chapter 30. Churchill Livingstone Elsevier, pp 195–202

  42. Miller GE (1990) The assessment of clinical skills/competence/performance. Acad Med 65:563–567

    Article  Google Scholar 

  43. http://www.psychometrics.cam.ac.uk/page/338/concerto-testing-platform.htm. Accessed 27 Aug 2013

  44. Birnbaum A (1968) Some latent trait models and their use in inferring an examinee’s ability. Part 5 in FM Lord, MR Novick. 1968 Statistical theories of mental health scores. Addison-Wesley, Reading

  45. Weiss DJ, Kingsbury GG (1984) Application of computerized adaptive testing to educational problems. J Educ Meas 1984(21):361–375

    Article  Google Scholar 

  46. Foy F (2013) The logistics of clinical assessment. RCSI Institute of Leadership Data bank, Dublin

    Google Scholar 

  47. Wass V, Ven der Vieuten C, Shatzer J, Jones R (2001) Assessment of clinical competence. Lancet 357:945–949

    Article  CAS  PubMed  Google Scholar 

  48. O’Neill G, Doyle E, O’Boyle K, Clipson N. Choice of assessment methods within a module: students’ experiences and staff recommendations for practice. AISHE 2010. http://ocs.aoshe.org/aishe/index/.php/international/2010/paper/paper/view/155

Download references

Conflict of interest

There are no conflicts of interest.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to W. Tormey.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tormey, W. Education, learning and assessment: current trends and best practice for medical educators. Ir J Med Sci 184, 1–12 (2015). https://doi.org/10.1007/s11845-014-1069-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11845-014-1069-4

Keywords

Navigation