Skip to main content

Effect of a Formative Objective Structured Clinical Examination on the Clinical Performance of Undergraduate Medical Students in a Summative Examination: A Randomized Controlled Trial

Abstract

Objective

To study the effect of formative Objective structured clinical examination (OSCE) on the undergraduate medical students’ performance in a subsequent summative-OSCE assessment.

Methods

In a randomized single-blind trial, 130 fifth year medical students at Raparin hospital, Erbil were assigned to intervention (n=61) and control group (n=69). Formative-OSCE was performed for the intervention group in pediatric module with feedback on their performance versus standard pediatric module for the control group. Students’ clinical performance was assessed by a summative-OSCE. Multiple regression was used to predict the summative-OSCE score depending on the participation in formative-OSCE along with the other factors.

Results

Eleven students were excluded because of early drop-out, leaving 119 students for analysis. The summative-OSCE mean score (out of a total score of 100) in intervention group 64.6 (10.91) was significantly lower as compared to the control group 69.2 (10.45).

Conclusion

Single formative-OSCE does not necessarily lead to better performance in subsequent summative-OSCE.

This is a preview of subscription content, access via your institution.

References

  1. Carrillo-de-la-Peña MT, Baillès E, Caseras X, Martínez À, Ortet G, Pérez J. Formative assessment and academic achievement in pre-graduate students of health sciences. Adv Heal Sci Educ. 2009;14:61–7.

    Article  Google Scholar 

  2. Siddiqui ZS. Framework for an effective assessment: From rocky roads to silk route. Pakistan J Med Sci. 2017;33:505–9.

    Google Scholar 

  3. Tridane M, Belaaouad S, Benmokhtar S, Gourja B, Radid M. The impact of formative assessment on the learning process and the unreliability of the mark for the summative evaluation. Procedia -Social Behav Sci. 2015;197:680–5.

    Article  Google Scholar 

  4. Pugh D, Desjardins I, Eva K. How do formative objective structured clinical examinations drive learning? Analysis of residents’ perceptions. Med Teach. 2018;40:45–52.

    Article  Google Scholar 

  5. Konopasek L, Norcini J, Krupat E. Focusing on the formative: Building an assessment system aimed at student growth and development. Acad Med. 2016;91:1492–7.

    Article  Google Scholar 

  6. Chisnall B, Vince T, Hall S, Tribe R. Evaluation of outcomes of a formative objective structured clinical examination for second-year UK medical students. Int J Med Educ. 2015;6:76–83.

    Article  Google Scholar 

  7. Sobh AH, Austin Z, Izham MIM, Diab MI, Wilby KJ. Application of a systematic approach to evaluating psychometric properties of a cumulative exit-from-degree objective structured clinical examination (OSCE). Curr Pharm Teach Learn. 2017;9:1091–8.

    Article  Google Scholar 

  8. Gupta P, Dewan P, Singh T. Objective structured clinical examination (OSCE) revisited. Indian Pediatr. 2010;47:911–20.

    Article  Google Scholar 

  9. Townsend AH, Mcllvenny S, Miller CJ, Dunn E V. The use of an objective structured clinical examination (OSCE) for formative and summative assessment in a general practice clinical attachment and its relationship to final medical school examination performance. Med Educ. 2001;35:841–6.

    CAS  Article  Google Scholar 

  10. Furmedge DS, Smith L-J, Sturrock A. Developing doctors: What are the attitudes and perceptions of year 1 and 2 medical students towards a new integrated formative objective structured clinical examination? BMC Med Educ. 2016;16:32.

    Article  Google Scholar 

  11. Farahat E, Javaherian-Dysinger H, Rice G, Schneider L, Daher N, Heine N. Exploring students’ perceptions of the educational value of formative objective structured clinical examination (OSCE) in a nutrition program. J Allied Health. 2016;45:20–6.

    PubMed  Google Scholar 

  12. Jain V, Agrawal V, Biswas S. Formative assessment as an educational tool. J Ayub Med C Abbottabad. 2012;24:68–70.

    Google Scholar 

  13. Bernard AW, Ceccolini G, Feinn R, Rockfeld J, Rosenberg I, Thomas L, et al. Medical students review of formative OSCE scores, checklists, and videos improves with student-faculty debriefing meetings. Med Educ Online. 2017;22:1324718

    Article  Google Scholar 

  14. Gums TH, Kleppinger EL, Urick BY. Outcomes of individualized formative assessments in a pharmacy skills laboratory. Am J Pharm Educ. 2014;78:166.

    Article  Google Scholar 

  15. Lien H-H, Hsu S-F, Chen S-C, Yeh J-H. Can teaching hospitals use serial formative OSCEs to improve student performance? BMC Res Notes. 2016;9:464.

    Article  Google Scholar 

  16. Radford BW. The effect of formative assessments on teaching and learning [Master]. Brigham Young University. 2010. Available from: https://scholarsarchive.byu.edu/etd/2086. Accessed January 10, 2019.

  17. Lipnevich AA, Smith JK. Response to assessment feedback: The effects of grades, praise, and source of information. ETS Research Report Series. 2008;1:i–57.

    Article  Google Scholar 

  18. Kluger AN, Denisi A. The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull. 1996;9:254–84.

    Article  Google Scholar 

  19. Butler R. Enhancing and undermining intrinsic motivation: The effects of task involving and ego involving evaluation on interest and performance. Br J Educ Psychol. 1988;58:1–14.

    Article  Google Scholar 

  20. Van der Kleij F. Computer-based feedback in formative assessment. University of Twente 2013. Available from: https://www.researchgate.net/profile/Fabienne_Van_Der_Kleij/publication/304628867_Computer-based_feedback_in_formative_assessment/links/57759dbf08aead7ba0700138/Computer-based-feedback-in-formative-assessment.pdf. Accessed January 10, 2019.

Download references

Funding

Funding: Hawler Medical University. No contribution to data design, collection, analysis or interpretation was made by the funding resource.

Author information

Authors and Affiliations

Authors

Contributions

Contributors: MI,NA,AA: study design and concept; NG was the trial coordinator and participated in data analysis and interpretation. NA: data collection, data entry and wrote the draft of manuscript. All authors critically reviewed and approved the manuscript.

Corresponding author

Correspondence to Nazdar Ezzaddin Alkhateeb.

Additional information

Competing Interest: None stated.

Ethical clearance: The study was approved by Ethics Committee of the College of Medicine of Hawler Medical University (document no.16, 23/4/2016)

Trial Registration: Clinical trial.gov/NCT 035 99232.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Alkhateeb, N.E., Al-Dabbagh, A., Ibrahim, M. et al. Effect of a Formative Objective Structured Clinical Examination on the Clinical Performance of Undergraduate Medical Students in a Summative Examination: A Randomized Controlled Trial. Indian Pediatr 56, 745–748 (2019). https://doi.org/10.1007/s13312-019-1641-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13312-019-1641-0

Keywords

  • Assessment
  • Clinical competence
  • Educational measurement
  • Medical Eduation