Skip to main content

Tracing Philosophical Shifts in Health Professions Assessment

  • Chapter
  • First Online:

Abstract

Assessment of clinical competence continues to challenge the health professions, leading educators and researchers to seek new solutions to long existing and newly identified problems. Broadening definitions of competence, increasing complexities of practice, the valuing and devaluing of some features of assessment, newly identified limitations in the way assessment is enacted, and much more, provide ongoing stimuli for advancement and change. In most assessment contexts, philosophical positions play a fundamental role, yet they are too-often left implicit. In this chapter, we explore philosophical positions and shifts that have influenced assessment practices in health professions education. Our aim is to describe how shifts in perspective have informed health professional assessment and to outline their consequences. We offer that because reflecting on the relationship between philosophical positions and assessment science provides opportunities and mechanisms through which miscommunication and insufficient practice might be resolved. That is, we hope this chapter prompts health professional educators to identify and critically examine their guiding assumptions, commitments, and intellectual frameworks. Through applied philosophy, the field can re-examine and reformulate existing and future strategy in a manner that can allow complex assessment challenges to be approached in ways that enable practical issues to be more deeply understood and advanced.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Borsboom, Denny, and Keith A. Markus. 2013. Truth and Evidence in Validity Theory. Journal of Educational Measurement 50 (1): 110–114.

    Article  Google Scholar 

  • Chalmers, Alan F. 2013. What Is This Thing Called Science? Indianapolis: Hackett Publishing Company.

    Google Scholar 

  • Cronbach, Lee J., Goldine C. Gleser, Nanda Harinder, and Nageswari Rajaratnam. 1972. The Dependability of Behavioural Measurements: Theory of Generalizability for Scores and Profiles. New York: Wiley.

    Google Scholar 

  • Crossley, Jim, Gavin Johnson, Joe Booth, and Winnie Wade. 2011. Good Questions, Good Answers: Construct Alignment Improves the Performance of Workplace-Based Assessment Scales. Medical Education 45 (6): 560–569.

    Article  Google Scholar 

  • De la Croix, Anne, and Mario Veen. 2018. The Reflective Zombie: Problematizing the Conceptual Framework of Reflection in Medical Education. Perspectives on Medical Education 7 (6): 394–400.

    Google Scholar 

  • Dent, John, Ronald Harden, and Dan Hunt. 2021. A Practical Guide for Medical Teachers, EBook. Elsevier Health Sciences.

    Google Scholar 

  • Eva, Kevin W. 2018. Cognitive Influences on Complex Performance Assessment: Lessons from the Interplay Between Medicine and Psychology. Journal of Applied Research in Memory and Cognition 7 (2): 177–188.

    Article  Google Scholar 

  • Eva, Kevin W., Glenn Regehr, and Larry D. Gruppen. 2014. Blinded by “Insight”. In The Question of Competence, ed. Brian D. Hodges and Lorelei Lingard, 131–154. New York: ILR Press Ithaca.

    Google Scholar 

  • Eva, Kevin W., Georges Bordage, Craig Campbell, Robert Galbraith, Shipra Ginsberg, Eric Holmboe, and Glenn Regehr. 2016. Towards a Program of Assessment for Health Professionals: From Training into Practice. Advances in Health Sciences Education 21: 897–913.

    Article  Google Scholar 

  • Gauthier, Geneviève, Christina St-Onge, and Walter Taveres. 2016. Rater Cognition: Review and Integration of Research Findings. Medical Education 50 (5): 511–522.

    Article  Google Scholar 

  • Gielen, Sarah, Filip Dochy, and Sabine Dierick. 2003. Evaluating the Consequential Validity of New Modes of Assessment: The Influence of Assessment on Learning, Including Pre-, Post-, and True Assessment Effects. In Optimising New Modes of Assessment: In Search of Qualities and Standards, ed. Mien Segers, Filip Dochy, and Eduardo Cascallar, 37–54. London: Springer.

    Chapter  Google Scholar 

  • Gingerich, Andrea, Glenn Regehr, and Kevin W. Eva. 2011. Rater-based assessments as social judgements: Rethinking the etiology of rater errors. Academic Medicine 86 (10): S1–S7.

    Article  Google Scholar 

  • Gingerich, Andrea, Jennifer Kogan, Peter Yeates, Marjan Govaerts, and Eric Holmboe. 2014a. Seeing the ‘Black Box’ Differently: Assessor Cognition from Three Research Perspectives. Medical Education 48 (11): 1055–1068.

    Article  Google Scholar 

  • Gingerich, Andrea, Cees P.M. van der Vleuten, Kevin W. Eva, and Glenn Regehr. 2014b. More Consensus Than Idiosyncrasy: Categorizing Social Judgments to Examine Variability in Mini-CEX Ratings. Academic Medicine 89 (11): 1510–1519.

    Article  Google Scholar 

  • Ginsburg, Shipra, Glenn Regehr, Lorelei Lingard, and Kevin W. Eva. 2015. Reading Between the Lines: Faculty Interpretations of Narrative Evaluation Comments. Medical Education 49 (3): 296–306.

    Article  Google Scholar 

  • Govaerts, Marjan J.B. 2016. Competence in Assessment: Beyond Cognition. Medical Education 50 (5): 502–504.

    Article  Google Scholar 

  • Hanson, Janice L., Adam A. Rosenberg, and J. Lindsey Lane. 2013. Narrative Descriptions Should Replace Grades and Numerical Ratings for Clinical Performance in Medical Education in the United States. Frontiers in Psychology 4: 668.

    Google Scholar 

  • Hauer, Karen E., Olle ten Cate, Christy Boscardin, William Iobst, Eric Holmboe, Benjamin Chesluk, Robert B. Baron, and Patricia O’Sullivan. 2016. Ensuring Resident Competence: A Narrative Review of the Literature on Group Decision Making to Inform the Work of Clinical Competency Committees. Journal of Graduate Medical Education 8 (2): 156–164.

    Article  Google Scholar 

  • Hodges, Brian. 2013. Assessment in the Post-psychometric Era: Learning to Love the Subjective and Collective. Medical Teacher 35 (7): 564–568.

    Article  Google Scholar 

  • Ilgen, Jonathan S., Kevin W. Eva, Anique de Bruin, David A. Cook, and Glenn Regehr. 2019. Comfort with Uncertainty: Reframing Our Conceptions of How Clinicians Navigate Complex Clinical Situations. Advances in Health Sciences Education 24: 797–809.

    Article  Google Scholar 

  • Kane, Michael T. 2001. Current Concerns in Validity Theory. Journal of Educational Measurement 38 (4): 319–342.

    Article  Google Scholar 

  • Kane, Michael T. 2013a. Validating the Interpretations and Uses of Test Scores. Journal of Educational Measurement 50 (1): 1–73.

    Article  Google Scholar 

  • Kane, Michael T. 2013b. Validation as a Pragmatic, Scientific Activity. Journal of Educational Measurement 50 (1): 115–122.

    Article  Google Scholar 

  • Mann, Karen, Cees van der Vleuten, Kevin W. Eva, Heather Armson, Ben Chesluk, Tim Dornan, Eric Holmboe, Jocelyn Lockyer, Elaine Loney, and Joan Sargeant. 2011. Tensions in Informed Self-Assessments: How the Desire for Feedback and Reticence to Collect and Use It Can Conflict. Academic Medicine 86 (9): 1120–1127.

    Article  Google Scholar 

  • Pack, Rachael, Lorelei Lingard, Christopher Watling, Saad Chahine, and Sayra Cristancho. 2019. Some Assembly Required: Tracing the Interpretative Work of Clinical Competency Committees. Medical Education 53 (7): 723–734.

    Article  Google Scholar 

  • Pearce, Jacob, and Walter Tavares. 2021. A Philosophical History of Programmatic Assessment: Tracing Shifting Configurations. Advances in Health Sciences Education 26 (4): 1291–1310.

    Article  Google Scholar 

  • Pugh, Deborah, Isabelle Desjardins, and Kevin W. Eva. 2018. How Do Formative Objective Structured Clinical Examinations Drive Learning? Analysis of Residents’ Perceptions. Medical Teacher 40 (1): 45–52.

    Article  Google Scholar 

  • Schuwirth, Lambert W., and Cees van der Vleuten. 2020. A History of Assessment in Medical Education. Advances in Health Sciences Education 25 (5): 1045–1056.

    Article  Google Scholar 

  • Sebok-Syer, Stefanie S., Jennifer M. Shaw, Farah Asghar, Michael Panza, Mark D. Syer, and Lorelei Lingard. 2021. A Scoping Review of Approaches for Measuring “Interdependent” Collaborative Performances. Medical Education 55 (10): 1123–1130.

    Article  Google Scholar 

  • St-Onge, Christina, Meredith Young, Kevin W. Eva, and Brian Hodges. 2017. Validity: One Word with a Plurality of Meanings. Advances in Health Sciences Education 22 (4): 853–867.

    Article  Google Scholar 

  • Tavares, Walter, Alexander Sadowski, and Kevin W. Eva. 2018. Asking for Less and Getting More: The Impact of Broadening a Rater’s Focus in Formative Assessment. Academic Medicine 93 (10): 1584–1590.

    Article  Google Scholar 

  • Tavares, Walter, Ayelet Kuper, Kulamakan Kulasegaram, and Cynthia Whitehead. 2020. The Compatibility Principle: On Philosophies in the Assessment of Clinical Competence. Advances in Health Sciences Education 25: 1–16.

    Article  Google Scholar 

  • ten Cate, Olle, and Glenn Regehr. 2019. The Power of Subjectivity in the Assessment of Medical Trainees. Academic Medicine 94 (3): 333–337.

    Article  Google Scholar 

  • van der Vleuten, Cees P.M. 1996. The Assessments of Professional Competence: Developments, Research and Practical Implications. Advances in Health Sciences Education 1: 41–67.

    Article  Google Scholar 

  • van der Vleuten, Cees P.M., and Lambert Schuwirth. 2005. Assessing Professional Competence: From Methods to Programmes. Medical Education 39 (3): 309–317.

    Article  Google Scholar 

  • van der Vleuten, Cees P.M., Sylvia Heeneman, and Suzanne Schut. 2019. Programmatic Assessment: An Avenue to a Different Assessment Culture. In Assessment in Health Professions Education, ed. Rachel Yudkowsky, Yoon Soo Park, and Steven M. Downing. Amsterdam: Routledge.

    Google Scholar 

  • Veen, Mario, John Skelton, and Anne de la Croix. 2020. Knowledge, Skills and Beetles: Respecting the Privacy of Private Experiences in Medical Education. Perspectives on Medical Education 9: 111–116.

    Article  Google Scholar 

  • Yudkowsky, Rachel, Yoon Soo Park, and Steven M. Downing. 2019. Assessment in Health Professions Education. Amsterdam: Routledge.

    Book  Google Scholar 

  • Zoanetti, Nathan, and Jacob Pearce. 2020. The Potential Use of Bayesian Networks to Support Committee Decisions in Programmatic Assessment. Medical Education 55 (7): 808–817.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Walter Tavares .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Tavares, W., Pearce, J., Eva, K. (2022). Tracing Philosophical Shifts in Health Professions Assessment. In: Brown, M.E.L., Veen, M., Finn, G.M. (eds) Applied Philosophy for Health Professions Education. Springer, Singapore. https://doi.org/10.1007/978-981-19-1512-3_6

Download citation

  • DOI: https://doi.org/10.1007/978-981-19-1512-3_6

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-19-1511-6

  • Online ISBN: 978-981-19-1512-3

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics