Skip to main content

Advertisement

SpringerLink
Log in

Lessons Learnt from the Development and Implementation of an Online Assessment System for Medical Science Programmes

  • Monograph
  • Published:
Medical Science Educator Aims and scope Submit manuscript

Abstract

Challenges in assessment implementation include assessment blueprinting, accuracy and timeliness of result processing, item analysis and personalised feedback. These challenges were addressed by an online assessment system (OAS) that translates the educational framework of outcome-based education (OBE) into an integrated platform applicable across academic programmes. OBE principles of transparency, measurability, relevance, and individualisation was feasibly addressed using technology. The system development required continuous stakeholder engagement and feedback. Its implementation involved change management at institutional level with shifts in procedures, responsibilities, staff competencies and resource allocation. This article describes approaches taken and the lessons learned in developing and implementing OAS to enhance assessment practice for medical science programmes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. GMC. Assessment in Undergraduate Medical Education: Advice Supplementary to Tomorrow’s Doctors (2009). General Medical Council. 2011. https://www.gmc-uk.org/-/media/documents/Assessment_in_undergraduate_medical_education___guidance_0815.pdf_56439668.pdf. Accessed 12 Mar 2019.

  2. Downing SM, Yudkowsky R. Importance of assessment in health professions education. In: Downing SM, Yudkowsky R, editors. Assessment in health professions education. New York: Routledge; 2009. p. 1–20.

    Chapter  Google Scholar 

  3. WFME. Standards. World Federation for Medical Education. 2018. http://wfme.org/standards/. Accessed 12 Mar 2019.

  4. QAA. UK quality code for higher education. Part B: assuring and enhancing academic quality, chapter B6: assessments of students and the recognition of prior learning. The Quality Assurance Agency for Higher Education. 2018. http://www.qaa.ac.uk/docs/qaa/quality-code/chapter-b6_-assessment-of-students-and-the-recognition-of-prior-learning.pdf?sfvrsn=9901f781_8. Accessed 12 Mar 2019.

  5. Davis M. Can college rankings be believed? J Des Econ Innov. 2016;2(3):215–30.

    Google Scholar 

  6. Shumway JM, Harden RM. AMEE guide no. 25: the assessment of learning outcomes for the competent and reflective physician. Med Teach. 2003;25(6):569–84.

    Article  Google Scholar 

  7. Owen JM. Program evaluation: forms and approaches. 3rd ed. New York: Guildford Publications; 2006.

    Google Scholar 

  8. Holmboe ES, Ward DS, Riznick RK, Katsufrakis PJ, Leslie KM, Patel VL, et al. Faculty development in assessment: the missing link in competency-based medical education. Acad Med. 2011;86(4):460–7.

    Article  Google Scholar 

  9. Brown T. Design thinking. Harv Bus Rev. 2008;86(6):84–92.

    Google Scholar 

  10. McKimm J, Swanwick T. Educational leadership. In: Swanwick T, editor. Understanding medical education: evidence, theory and practice. Chichester: John Wiley & Sons; 2014. p. 473–91.

    Google Scholar 

  11. ISO. ISO 31000:2018 Risk Management Guidelines. ISO. 2018. https://www.iso.org/obp/ui/#iso:std:iso:31000:ed-2:v1:en. Accessed 12 Mar 2019.

  12. IDEAL Consortium. International databases for enhanced assessments and learning. IDEAL Consortium management company limited. 2016. https://www.idealmed.org/2019/. Accessed 12 Mar 2019.

  13. Norcini J, Anderson B, Bollela V, Burch V, Costa MJ, Duvivier R, et al. 2018 consensus framework for good assessment. Med Teach. 2018;40:1102–9. https://doi.org/10.1080/0142159X.2018.1500016.

    Article  Google Scholar 

  14. Senior B. Organisational change. 2nd ed. London: Prentice Hall.

  15. Kotter JP. Leading change. Boston: Harvard Business School Press; 1996.

    Google Scholar 

  16. By RT. Organisational change management: a critical review. J Chang Manag. 2005;5(4):369–80.

    Article  Google Scholar 

  17. Boeve AJ, Meijer RR, Albers CJ, Beetsma Y, Bosker RJ. Introducing computer-based testing in high-stakes exams in higher education: results of a field experiment. PLoS One. 2015;10(12):e0143616.

    Article  Google Scholar 

  18. Moran JW, Brightman BK. Leading organizational change. J Workplace Learn: Empl Couns Today. 2000;12(2):66–74.

    Article  Google Scholar 

  19. McKimm J, O’Sullivan H. Leadership, Management and mentoring: applying theory to practice. In: Cleland J, Durning SJ, editors. Researching medical education. Chichester: John Wiley & Sons; 2015. p. 269–80.

    Chapter  Google Scholar 

  20. Evans-Andris M. Barrier to computer integration: micro-interaction among computer co-ordinators and classroom teachers in elementary schools. J Res Comput Educ. 1995;28:29–45.

    Article  Google Scholar 

  21. Robertson SI, Calder J, Fung P, Jones A, O’Shea T, Lambrechts G. Pupils, teachers and palmtop computers. J Comput Assist Learn. 1996;12:194–204.

    Article  Google Scholar 

  22. Walsh K. Point of view: online assessment in medical education – current trends and future directions. Malawi Med J. 2015;27(2):71–2.

    Article  Google Scholar 

Download references

Acknowledgments

We would like to acknowledge Chin Sheau Yuen, Business Applications Assistant Manager of the IT Department of International Medical University, for the technical assistance provided during the development of the Online Assessment System at the university.

Author information

Authors and Affiliations

  1. Faculty of Medicine and Health, International Medical University, No. 126, Jalan Jalil Perkasa 19, Bukit Jalil, 57000, Kuala Lumpur, Malaysia

    Hui Meng Er, Vishna Devi Nadarajah, Noraidah Yusoff & Kelly L. Y. Loh

  2. College of Medicine and Dentistry, James Cook University, Townsville, QLD, 4811, Australia

    Richard B. Hays

Authors
  1. Hui Meng Er
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vishna Devi Nadarajah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Richard B. Hays
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Noraidah Yusoff
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kelly L. Y. Loh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vishna Devi Nadarajah.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

NA, as this is a reflection from the authors in the form of a monograph with lessons learned.

Informed Consent

NA, as no participants were recruited. Stakeholders feedback was extracted from the OAS project evaluation report.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Er, H.M., Nadarajah, V.D., Hays, R.B. et al. Lessons Learnt from the Development and Implementation of an Online Assessment System for Medical Science Programmes. Med.Sci.Educ. 29, 1103–1108 (2019). https://doi.org/10.1007/s40670-019-00802-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40670-019-00802-5

Keywords

Search

Navigation