Abstract
Despite calls for feedback to be incorporated in all assessments, a dichotomy exists between formative and summative assessments. When feedback is provided in a summative context, it is not always used effectively by learners. In this study we explored the reasons for this. We conducted individual interviews with 17 students who had recently received web based feedback following a summative assessment. Constant comparative analysis was conducted for recurring themes. The summative assessment culture, with a focus on avoiding failure, was a dominant and negative influence on the use of feedback. Strong emotions were prevalent throughout the period of assessment and feedback, which reinforced the focus on the need to pass, rather than excel. These affective factors were heightened by interactions with others. The influence of prior learning experiences affected expectations about achievement and the need to use feedback. The summative assessment and subsequent feedback appeared disconnected from future clinical workplace learning. Socio-cultural influences and barriers to feedback need to be understood before attempting to provide feedback after all assessments. A move away from the summative assessment culture may be needed in order to maximise the learning potential of assessments.
Similar content being viewed by others
References
Altahawi, F., Sisk, B., Poloskey, S., Hicks, C., & Dannefer, E. F. (2012). Student perspectives on assessment: Experience in a competency-based portfolio system. Medical Teacher, 34, 221–225.
Archer, J. C. (2010). State of the science in health professional education: Effective feedback. Medical Education, 44, 101–108.
Ashford, S. J., & Cummings, L. L. (1983). Feedback as an individual resource—personal strategies of creating information. Organizational Behavior and Human Performance, 32, 370–398.
Bandura, A. (2001). Social cognitive theory. Annual Review of Psychology, 52, 1–26.
Bok, H. G. J., Teunissen, P. W., Spruijt, A., Fokkema, J. P. I., van Beukelen, P., Jaarsma, D. A. D. C., et al. (2013). Clarifying students’ feedback-seeking behaviour in clinical clerkships. Medical Education, 47, 282–291.
Cilliers, F. J., Schuwirth, L. W., Adendorff, H. J., Herman, N., & van der Vleuten, C. P. M. (2010). The mechanism of impact of summative assessment on medical students’ learning. Advances in Health Sciences Education, 15, 695–715.
Cilliers, F. J., Schuwirth, L. W., & van der Vleuten, C. P. M. (2012). A model of the pre-assessment learning effects of assessment is operational in an undergraduate clinical context. BMC Medical Education, 12, 9.
Corbin, J., & Strauss, A. (2008). Basics of qualitative research (3rd ed.). Thousand Oaks, CA: Sage.
Crommelinck, M., & Anseel, F. (2013). Understanding and encouraging feedback-seeking behaviour: A literature review. Medical Education, 47, 232–241.
Dannefer, E. F., & Henson, L. C. (2007). The portfolio approach to competency-based assessment at the Cleveland clinic lerner college of medicine. Academic Medicine, 82, 493–502.
DiCicco-Bloom, B., & Crabtree, B. F. (2006). The qualitative research interview. Medical Education, 40, 314–321.
Dijkstra, J., van der Vleuten, C. P. M., & Schuwirth, L. W. (2010). A new framework for designing programmes of assessment. Advances in Health Sciences Education, 15, 379–393.
Dochy, F., Segers, M., Gijbels, D., & Struyven, K. (2007). Assessment engineering: Breaking down barriers between teaching and learning, and assessment. In D. Boud & N. Falchikov (Eds.), Rethinking assessment in higher education: Learning for the longer term (pp. 87–100). Oxford: Routledge.
Driessen, E. W., van Tartwijk, J., Govaerts, M., Teunissen, P., & van der Vleuten, C. P. M. (2012). The use of programmatic assessment in the clinical workplace: A Maastricht case report. Medical Teacher, 34, 226–231.
Durning, S., & Artino, A. (2011). Situativity theory: A perspective on how participants and the environment can act. Medical Teacher, 33, 188–199.
Eva, K. W., Armson, H., Holmboe, E., Lockyer, J., Loney, E., Mann, K., et al. (2012). Factors influencing responsiveness to feedback: On the interplay between fear, confidence, and reasoning processes. Advances in Health Sciences Education, 17, 15–26.
Harrison, C. J., Könings, K. D., Molyneux, A., Schuwirth, L., Wass, V., & van der Vleuten, C. P. M. (2013). Web-based feedback after summative assessment: How do students engage? Medical Education, 47, 734–744.
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77, 81–112.
Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254–284.
Lingard, L., Albert, M., & Levinson, W. (2008). Grounded theory, mixed methods and action research. BMJ, 337, 459–461.
Mann, K., van der Vleuten, C., Eva, K., Armson, H., Chesluk, B., Dornan, T., et al. (2011). Tensions in informed self-assessment: How the desire for feedback and reticence to collect and use it can conflict. Academic Medicine, 86, 1120–1127.
Morrison, E. W., & Bies, R. J. (1991). Impression management in the feedback-seeking process—a literature review and research agenda. Academy of Management Review, 16, 522–541.
Moss, S. E., Valenzi, E. R., & Taggart, W. (2003). Are you hiding from your boss? The development of a taxonomy and instrument to assess the feedback management behaviours of good and bad performers. Journal of Management, 29, 487–510.
Norcini, J., Anerson, B., Bollela, V., Burch, V., Costa, M. J., Duvivier, R., et al. (2011). Criteria for good assessment: Consensus statement and recommendations from the Ottawa 2010 conference. Medical Teacher, 33, 206–214.
Northcraft, G. B., & Ashford, S. J. (1990). The preservation of self in everyday life—the effects of performance expectations and feedback context on feedback inquiry. Organizational Behavior and Human Decision Processes, 47, 42–64.
O’Carroll, P. J., & Fisher, P. (2013). Metacognitions, worry and attentional control in predicting OSCE performance test anxiety. Medical Education, 47, 562–568.
Patton, M. Q. (2002). Qualitative research and evaluation methods (3rd ed.). Newbury Park, CA: Sage.
Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students’ self-regulated learning and achievement: A program of qualitative and quantitative research. Educational psychologist, 37(2), 91–105.
Ramani, S., & Krackov, S. K. (2012). Twelve tips for giving feedback effectively in the clinical environment. Medical Teacher, 34, 787–791.
Rudland, J., Wilkinson, T., Smith-Han, K., & Thompson-Fawcett, M. (2008). “You can do it late at night or in the morning. You can do it at home, I did it with my flatmate”. The educational impact of an OSCE. Medical Teacher, 30, 206–211.
Sargeant, J., Mann, K., Sinclair, D., van der Vleuten, C., & Metsemakers, J. (2008). Understanding the influence of emotions and reflection upon multi-source feedback acceptance and use. Advances in Health Sciences Education, 13, 275–288.
Schuwirth, L. W. T., & van der Vleuten, C. P. M. (2011). Programmatic assessment: From assessment of learning to assessment for learning. Medical Teacher, 33, 478–485.
Shute, V. (2008). Focus on formative feedback. Review of Educational Research, 78, 153–189.
Sinclair, H. K., & Cleland, J. A. (2007). Undergraduate medical students: Who seeks formative feedback? Medical Education, 41, 580–582.
Teunissen, P. W., Stapel, D. A., van der Vleuten, C. P. M., Scherpbier, A. J. J. A., Boor, K., & Scheele, F. (2009). Who wants feedback? An investigation of the variables influencing residents’ feedback-seeking behavior in relation to night shifts. Academic Medicine, 84, 910–917.
Van de Ridder, J. M., Stokking, K. M., McGaghie, W. C., & ten Cate, O. T. J. (2008). What is feedback in clinical education? Medical Education, 42, 189–197.
van der Vleuten, C. P. M., & Schuwirth, L. W. (2005). Assessment of professional competence: From methods to programmes. Medical Education, 39, 309–317.
van der Vleuten, C. P. M., Schuwirth, L. W., Driessen, E., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., et al. (2012). A model for programmatic assessment fit for purpose. Medical Teacher, 34, 205–214.
Watling, C., Driessen, E., van der Vleuten, C. P. M., Vanstone, M., & Lingard, L. (2013). Beyond individualism: Professional culture and its influence on feedback. Medical Education, 47, 585–594.
Yardley, S., Teunissen, P. W., & Dornan, T. (2012). Experiential learning: AMEE guide no. 63. Medical Teacher, 34, e100–e115.
Acknowledgments
We are grateful to Sarah Yardley for independently coding some of the interviews, to Adrian Molyneux for setting up the feedback website and to Kirsty Hartley for helping to recruit students for the interviews. Finally, we are most grateful to all the students who took part in the interviews.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix 1: Screencaptures of webpages
The main menu page
An example Skills breakdown Webpage
An example Detailed Comparison Webpage
An example Station Breakdown Webpage
Part of the Next Steps Webpage
Appendix 2: Outline framework for Individual interviews
About OSCE itself |
How did you prepare for the OSCE this year? Please talk me through how you were feeling on the day of the OSCE Take me through the OSCE—how was that? How were you feeling at the end of the OSCE? |
About feedback provision |
Please can you talk me through what you did when you went online to look at the feedback What conclusions did you draw from the feedback? How could we make the feedback better for you? |
Has the feedback made you think about how you would approach a particular station in a different way in future? Do you think the feedback will make a difference to how you will work on the wards, in clinics or in practice? |
Does it matter to you how well you have done in an OSCE, or is it just important to have passed? Why? |
Rights and permissions
About this article
Cite this article
Harrison, C.J., Könings, K.D., Schuwirth, L. et al. Barriers to the uptake and use of feedback in the context of summative assessment. Adv in Health Sci Educ 20, 229–245 (2015). https://doi.org/10.1007/s10459-014-9524-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10459-014-9524-6