Abstract
Challenges in assessment implementation include assessment blueprinting, accuracy and timeliness of result processing, item analysis and personalised feedback. These challenges were addressed by an online assessment system (OAS) that translates the educational framework of outcome-based education (OBE) into an integrated platform applicable across academic programmes. OBE principles of transparency, measurability, relevance, and individualisation was feasibly addressed using technology. The system development required continuous stakeholder engagement and feedback. Its implementation involved change management at institutional level with shifts in procedures, responsibilities, staff competencies and resource allocation. This article describes approaches taken and the lessons learned in developing and implementing OAS to enhance assessment practice for medical science programmes.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
GMC. Assessment in Undergraduate Medical Education: Advice Supplementary to Tomorrow’s Doctors (2009). General Medical Council. 2011. https://www.gmc-uk.org/-/media/documents/Assessment_in_undergraduate_medical_education___guidance_0815.pdf_56439668.pdf. Accessed 12 Mar 2019.
Downing SM, Yudkowsky R. Importance of assessment in health professions education. In: Downing SM, Yudkowsky R, editors. Assessment in health professions education. New York: Routledge; 2009. p. 1–20.
WFME. Standards. World Federation for Medical Education. 2018. http://wfme.org/standards/. Accessed 12 Mar 2019.
QAA. UK quality code for higher education. Part B: assuring and enhancing academic quality, chapter B6: assessments of students and the recognition of prior learning. The Quality Assurance Agency for Higher Education. 2018. http://www.qaa.ac.uk/docs/qaa/quality-code/chapter-b6_-assessment-of-students-and-the-recognition-of-prior-learning.pdf?sfvrsn=9901f781_8. Accessed 12 Mar 2019.
Davis M. Can college rankings be believed? J Des Econ Innov. 2016;2(3):215–30.
Shumway JM, Harden RM. AMEE guide no. 25: the assessment of learning outcomes for the competent and reflective physician. Med Teach. 2003;25(6):569–84.
Owen JM. Program evaluation: forms and approaches. 3rd ed. New York: Guildford Publications; 2006.
Holmboe ES, Ward DS, Riznick RK, Katsufrakis PJ, Leslie KM, Patel VL, et al. Faculty development in assessment: the missing link in competency-based medical education. Acad Med. 2011;86(4):460–7.
Brown T. Design thinking. Harv Bus Rev. 2008;86(6):84–92.
McKimm J, Swanwick T. Educational leadership. In: Swanwick T, editor. Understanding medical education: evidence, theory and practice. Chichester: John Wiley & Sons; 2014. p. 473–91.
ISO. ISO 31000:2018 Risk Management Guidelines. ISO. 2018. https://www.iso.org/obp/ui/#iso:std:iso:31000:ed-2:v1:en. Accessed 12 Mar 2019.
IDEAL Consortium. International databases for enhanced assessments and learning. IDEAL Consortium management company limited. 2016. https://www.idealmed.org/2019/. Accessed 12 Mar 2019.
Norcini J, Anderson B, Bollela V, Burch V, Costa MJ, Duvivier R, et al. 2018 consensus framework for good assessment. Med Teach. 2018;40:1102–9. https://doi.org/10.1080/0142159X.2018.1500016.
Senior B. Organisational change. 2nd ed. London: Prentice Hall.
Kotter JP. Leading change. Boston: Harvard Business School Press; 1996.
By RT. Organisational change management: a critical review. J Chang Manag. 2005;5(4):369–80.
Boeve AJ, Meijer RR, Albers CJ, Beetsma Y, Bosker RJ. Introducing computer-based testing in high-stakes exams in higher education: results of a field experiment. PLoS One. 2015;10(12):e0143616.
Moran JW, Brightman BK. Leading organizational change. J Workplace Learn: Empl Couns Today. 2000;12(2):66–74.
McKimm J, O’Sullivan H. Leadership, Management and mentoring: applying theory to practice. In: Cleland J, Durning SJ, editors. Researching medical education. Chichester: John Wiley & Sons; 2015. p. 269–80.
Evans-Andris M. Barrier to computer integration: micro-interaction among computer co-ordinators and classroom teachers in elementary schools. J Res Comput Educ. 1995;28:29–45.
Robertson SI, Calder J, Fung P, Jones A, O’Shea T, Lambrechts G. Pupils, teachers and palmtop computers. J Comput Assist Learn. 1996;12:194–204.
Walsh K. Point of view: online assessment in medical education – current trends and future directions. Malawi Med J. 2015;27(2):71–2.
Acknowledgments
We would like to acknowledge Chin Sheau Yuen, Business Applications Assistant Manager of the IT Department of International Medical University, for the technical assistance provided during the development of the Online Assessment System at the university.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Ethical Approval
NA, as this is a reflection from the authors in the form of a monograph with lessons learned.
Informed Consent
NA, as no participants were recruited. Stakeholders feedback was extracted from the OAS project evaluation report.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Er, H.M., Nadarajah, V.D., Hays, R.B. et al. Lessons Learnt from the Development and Implementation of an Online Assessment System for Medical Science Programmes. Med.Sci.Educ. 29, 1103–1108 (2019). https://doi.org/10.1007/s40670-019-00802-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40670-019-00802-5