Abstract
Assessment of clinical competence continues to challenge the health professions, leading educators and researchers to seek new solutions to long existing and newly identified problems. Broadening definitions of competence, increasing complexities of practice, the valuing and devaluing of some features of assessment, newly identified limitations in the way assessment is enacted, and much more, provide ongoing stimuli for advancement and change. In most assessment contexts, philosophical positions play a fundamental role, yet they are too-often left implicit. In this chapter, we explore philosophical positions and shifts that have influenced assessment practices in health professions education. Our aim is to describe how shifts in perspective have informed health professional assessment and to outline their consequences. We offer that because reflecting on the relationship between philosophical positions and assessment science provides opportunities and mechanisms through which miscommunication and insufficient practice might be resolved. That is, we hope this chapter prompts health professional educators to identify and critically examine their guiding assumptions, commitments, and intellectual frameworks. Through applied philosophy, the field can re-examine and reformulate existing and future strategy in a manner that can allow complex assessment challenges to be approached in ways that enable practical issues to be more deeply understood and advanced.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Borsboom, Denny, and Keith A. Markus. 2013. Truth and Evidence in Validity Theory. Journal of Educational Measurement 50 (1): 110–114.
Chalmers, Alan F. 2013. What Is This Thing Called Science? Indianapolis: Hackett Publishing Company.
Cronbach, Lee J., Goldine C. Gleser, Nanda Harinder, and Nageswari Rajaratnam. 1972. The Dependability of Behavioural Measurements: Theory of Generalizability for Scores and Profiles. New York: Wiley.
Crossley, Jim, Gavin Johnson, Joe Booth, and Winnie Wade. 2011. Good Questions, Good Answers: Construct Alignment Improves the Performance of Workplace-Based Assessment Scales. Medical Education 45 (6): 560–569.
De la Croix, Anne, and Mario Veen. 2018. The Reflective Zombie: Problematizing the Conceptual Framework of Reflection in Medical Education. Perspectives on Medical Education 7 (6): 394–400.
Dent, John, Ronald Harden, and Dan Hunt. 2021. A Practical Guide for Medical Teachers, EBook. Elsevier Health Sciences.
Eva, Kevin W. 2018. Cognitive Influences on Complex Performance Assessment: Lessons from the Interplay Between Medicine and Psychology. Journal of Applied Research in Memory and Cognition 7 (2): 177–188.
Eva, Kevin W., Glenn Regehr, and Larry D. Gruppen. 2014. Blinded by “Insight”. In The Question of Competence, ed. Brian D. Hodges and Lorelei Lingard, 131–154. New York: ILR Press Ithaca.
Eva, Kevin W., Georges Bordage, Craig Campbell, Robert Galbraith, Shipra Ginsberg, Eric Holmboe, and Glenn Regehr. 2016. Towards a Program of Assessment for Health Professionals: From Training into Practice. Advances in Health Sciences Education 21: 897–913.
Gauthier, Geneviève, Christina St-Onge, and Walter Taveres. 2016. Rater Cognition: Review and Integration of Research Findings. Medical Education 50 (5): 511–522.
Gielen, Sarah, Filip Dochy, and Sabine Dierick. 2003. Evaluating the Consequential Validity of New Modes of Assessment: The Influence of Assessment on Learning, Including Pre-, Post-, and True Assessment Effects. In Optimising New Modes of Assessment: In Search of Qualities and Standards, ed. Mien Segers, Filip Dochy, and Eduardo Cascallar, 37–54. London: Springer.
Gingerich, Andrea, Glenn Regehr, and Kevin W. Eva. 2011. Rater-based assessments as social judgements: Rethinking the etiology of rater errors. Academic Medicine 86 (10): S1–S7.
Gingerich, Andrea, Jennifer Kogan, Peter Yeates, Marjan Govaerts, and Eric Holmboe. 2014a. Seeing the ‘Black Box’ Differently: Assessor Cognition from Three Research Perspectives. Medical Education 48 (11): 1055–1068.
Gingerich, Andrea, Cees P.M. van der Vleuten, Kevin W. Eva, and Glenn Regehr. 2014b. More Consensus Than Idiosyncrasy: Categorizing Social Judgments to Examine Variability in Mini-CEX Ratings. Academic Medicine 89 (11): 1510–1519.
Ginsburg, Shipra, Glenn Regehr, Lorelei Lingard, and Kevin W. Eva. 2015. Reading Between the Lines: Faculty Interpretations of Narrative Evaluation Comments. Medical Education 49 (3): 296–306.
Govaerts, Marjan J.B. 2016. Competence in Assessment: Beyond Cognition. Medical Education 50 (5): 502–504.
Hanson, Janice L., Adam A. Rosenberg, and J. Lindsey Lane. 2013. Narrative Descriptions Should Replace Grades and Numerical Ratings for Clinical Performance in Medical Education in the United States. Frontiers in Psychology 4: 668.
Hauer, Karen E., Olle ten Cate, Christy Boscardin, William Iobst, Eric Holmboe, Benjamin Chesluk, Robert B. Baron, and Patricia O’Sullivan. 2016. Ensuring Resident Competence: A Narrative Review of the Literature on Group Decision Making to Inform the Work of Clinical Competency Committees. Journal of Graduate Medical Education 8 (2): 156–164.
Hodges, Brian. 2013. Assessment in the Post-psychometric Era: Learning to Love the Subjective and Collective. Medical Teacher 35 (7): 564–568.
Ilgen, Jonathan S., Kevin W. Eva, Anique de Bruin, David A. Cook, and Glenn Regehr. 2019. Comfort with Uncertainty: Reframing Our Conceptions of How Clinicians Navigate Complex Clinical Situations. Advances in Health Sciences Education 24: 797–809.
Kane, Michael T. 2001. Current Concerns in Validity Theory. Journal of Educational Measurement 38 (4): 319–342.
Kane, Michael T. 2013a. Validating the Interpretations and Uses of Test Scores. Journal of Educational Measurement 50 (1): 1–73.
Kane, Michael T. 2013b. Validation as a Pragmatic, Scientific Activity. Journal of Educational Measurement 50 (1): 115–122.
Mann, Karen, Cees van der Vleuten, Kevin W. Eva, Heather Armson, Ben Chesluk, Tim Dornan, Eric Holmboe, Jocelyn Lockyer, Elaine Loney, and Joan Sargeant. 2011. Tensions in Informed Self-Assessments: How the Desire for Feedback and Reticence to Collect and Use It Can Conflict. Academic Medicine 86 (9): 1120–1127.
Pack, Rachael, Lorelei Lingard, Christopher Watling, Saad Chahine, and Sayra Cristancho. 2019. Some Assembly Required: Tracing the Interpretative Work of Clinical Competency Committees. Medical Education 53 (7): 723–734.
Pearce, Jacob, and Walter Tavares. 2021. A Philosophical History of Programmatic Assessment: Tracing Shifting Configurations. Advances in Health Sciences Education 26 (4): 1291–1310.
Pugh, Deborah, Isabelle Desjardins, and Kevin W. Eva. 2018. How Do Formative Objective Structured Clinical Examinations Drive Learning? Analysis of Residents’ Perceptions. Medical Teacher 40 (1): 45–52.
Schuwirth, Lambert W., and Cees van der Vleuten. 2020. A History of Assessment in Medical Education. Advances in Health Sciences Education 25 (5): 1045–1056.
Sebok-Syer, Stefanie S., Jennifer M. Shaw, Farah Asghar, Michael Panza, Mark D. Syer, and Lorelei Lingard. 2021. A Scoping Review of Approaches for Measuring “Interdependent” Collaborative Performances. Medical Education 55 (10): 1123–1130.
St-Onge, Christina, Meredith Young, Kevin W. Eva, and Brian Hodges. 2017. Validity: One Word with a Plurality of Meanings. Advances in Health Sciences Education 22 (4): 853–867.
Tavares, Walter, Alexander Sadowski, and Kevin W. Eva. 2018. Asking for Less and Getting More: The Impact of Broadening a Rater’s Focus in Formative Assessment. Academic Medicine 93 (10): 1584–1590.
Tavares, Walter, Ayelet Kuper, Kulamakan Kulasegaram, and Cynthia Whitehead. 2020. The Compatibility Principle: On Philosophies in the Assessment of Clinical Competence. Advances in Health Sciences Education 25: 1–16.
ten Cate, Olle, and Glenn Regehr. 2019. The Power of Subjectivity in the Assessment of Medical Trainees. Academic Medicine 94 (3): 333–337.
van der Vleuten, Cees P.M. 1996. The Assessments of Professional Competence: Developments, Research and Practical Implications. Advances in Health Sciences Education 1: 41–67.
van der Vleuten, Cees P.M., and Lambert Schuwirth. 2005. Assessing Professional Competence: From Methods to Programmes. Medical Education 39 (3): 309–317.
van der Vleuten, Cees P.M., Sylvia Heeneman, and Suzanne Schut. 2019. Programmatic Assessment: An Avenue to a Different Assessment Culture. In Assessment in Health Professions Education, ed. Rachel Yudkowsky, Yoon Soo Park, and Steven M. Downing. Amsterdam: Routledge.
Veen, Mario, John Skelton, and Anne de la Croix. 2020. Knowledge, Skills and Beetles: Respecting the Privacy of Private Experiences in Medical Education. Perspectives on Medical Education 9: 111–116.
Yudkowsky, Rachel, Yoon Soo Park, and Steven M. Downing. 2019. Assessment in Health Professions Education. Amsterdam: Routledge.
Zoanetti, Nathan, and Jacob Pearce. 2020. The Potential Use of Bayesian Networks to Support Committee Decisions in Programmatic Assessment. Medical Education 55 (7): 808–817.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Tavares, W., Pearce, J., Eva, K. (2022). Tracing Philosophical Shifts in Health Professions Assessment. In: Brown, M.E.L., Veen, M., Finn, G.M. (eds) Applied Philosophy for Health Professions Education. Springer, Singapore. https://doi.org/10.1007/978-981-19-1512-3_6
Download citation
DOI: https://doi.org/10.1007/978-981-19-1512-3_6
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-19-1511-6
Online ISBN: 978-981-19-1512-3
eBook Packages: EducationEducation (R0)