Abstract
Competency frameworks provide a link between professional practice, education, training, and assessment. They support and inform downstream processes such as curriculum design, assessment, accreditation and professional accountability. However, existing guidelines are limited in accounting for the complexities of professional practice potentially undermining utility of such guidelines and validity of outcomes. This necessitates additional ways of “seeing” situated and context-specific practice. We highlight what a conceptual framework informed by systems thinking can offer when developing competency frameworks. Mirroring shifts towards systems thinking in program evaluation and quality improvement, we suggest that similar approaches that identify and make use of the role and influence of system features and contexts can provide ways of augmenting existing guidelines when developing competency frameworks. We framed a systems thinking approach in two ways. First using an adaptation of Ecological Systems Theory which offers a realist perspective of the person and environment, and the evolving interaction between the two. Second, by employing complexity thinking, which obligates attention to the relationships and influences of features within the system, we can explore the multiple complex, unique, and context-embedded problems that exist within and have stake in real-world practice settings. The ability to represent clinical practice when developing competency frameworks can be improved when features that may be relevant, including their potential interactions, are identified and understood. A conceptual framework informed by systems thinking makes visible features of a practice in context that may otherwise be overlooked when developing competency frameworks using existing guidelines.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Armson, R. (2011). Growing wings on the way systems thinking for messy situations. Triarchy Press.
Batalden, P. B., Nelson, E., Gardent, P., & Godfrey, M. (2005). Leading the Macrosystem and Mesosystem for Microsystem Peak Performance. In S. Berman (Ed.), From front office to front line : Essential issues for health care leaders.Joint Commission Resources and the Institute for Healthcare Improvement.
Batt, A. M., Tavares, W., & Williams, B. (2020). The development of competency frameworks in healthcare professions: A scoping review. Advances in Health Sciences Education, 25(4), 913–987. https://doi.org/10.1007/s10459-019-09946-w
Bell, E. J. (2010). Climate change: What competencies and which medical education and training approaches? BMC Medical Education, 10(1), 31. https://doi.org/10.1186/1472-6920-10-31
Bodenheimer, T., & Sinsky, C. (2014). From triple to quadruple aim: Care of the patient requires care of the provider. The Annals of Family Medicine, 12(6), 573–576. https://doi.org/10.1370/afm.1713
Bordage, G. (2009). Conceptual frameworks to illuminate and magnify. Medical Education, 43(4), 312–319. https://doi.org/10.1111/j.1365-2923.2009.03295.x
Brightwell, A., & Grant, J. (2013). Competency-based training: Who benefits? Postgraduate Medical Journal, 89(1048), 107–110. https://doi.org/10.1136/postgradmedj-2012-130881
Bronfenbrenner, U. (1979). The ecology of human development. Harvard University Press.
Brown, C. A. (2006). The application of complex adaptive systems theory to clinical practice in rehabilitation. Disability and Rehabilitation, 28(9), 587–593. https://doi.org/10.1080/00222930500219175
Burke, K. (1984). Permanence and change: An anatomy of purpose (3rd ed.). University of California .
Carey, W. A., & Colby, C. E. (2013). Educating fellows in practice-based learning and improvement and systems-based practice : The value of quality improvement in clinical practice ☆. Journal of Critical Care, 28(1), 112.e1-112.e5. https://doi.org/10.1016/j.jcrc.2012.07.003
Castellani, B. (2018). 2018 Map of the Complexity Sciences. Available at: https://www.art-sciencefactory.com/complexity-map_feb09.html. Accessed January 10, 2021
Castellani, B., Rajaram, R., Buckwalter, J. G., Ball, M., & Hafferty, F. (2015a). Place and health as complex systems: A case study and empirical test. In SpringerBriefs in public health. Springer.
Castellani, B., Rajaram, R., Buckwalter, J. G., Ball, M., & Hafferty, F. (2015b). The complexities of place approach. SpringerBriefs in Public Health. https://doi.org/10.1007/978-3-319-09734-3_1
Castillo, E. G., Isom, J., DeBonis, K. L., Jordan, A., Braslow, J. T., & Rohrbaugh, R. (2020). Reconsidering systems-based practice. Academic Medicine. https://doi.org/10.1097/ACM.0000000000003559
Chaffee, M. W., & McNeill, M. M. (2007). A model of nursing as a complex adaptive system. Nursing Outlook, 55(5), 232-241.e3. https://doi.org/10.1016/j.outlook.2007.04.003
Dobbs, C., & Burholt, V. (2016). End-of-life-care for older people in Wales : Policy, practice and the effectiveness of the Integrated Care Pathway Final Report, (October). https://doi.org/10.13140/RG.2.2.13521.74085
Doll, W. E., Jr., & Trueit, D. (2010). Complexity and the health care professions. Journal of Evaluation in Clinical Practice, 16(4), 841–848. https://doi.org/10.1111/j.1365-2753.2010.01497.x
Dyne, P. L. (2002). Systems-based practice: The sixth core competency. Academic Emergency Medicine, 9(11), 1270–1277. https://doi.org/10.1197/aemj.9.11.1270
Ellaway, R. H., Bates, J., & Teunissen, P. W. (2017). Ecological theories of systems and contextual change in medical education. Medical Education, 51(12), 1250–1259. https://doi.org/10.1111/medu.13406
Englander, R., Agostinucci, W., Zalneraiti, E., & Carraccio, C. L. (2006). Teaching residents systems-based practice through a hospital cost-reduction program: A “Win–Win” situation. Teaching and Learning in Medicine, 18(2), 150–152. https://doi.org/10.1207/s15328015tlm1802_10
Ettekal, A., & Mahoney, J. (2017). Ecological systems theory. In K. Peppler (Ed.), The SAGE encyclopedia of out-of-school learning.SAGE Publications Inc. https://doi.org/10.4135/9781483385198.n94
Evans, R. J., & Donnelly, G. W. (2006). A model to describe the relationship between knowledge, skill, and judgment in nursing practice. Nursing Forum, 41(4), 150–157. https://doi.org/10.1111/j.1744-6198.2006.00053.x
Fraser, S. W., & Greenhalgh, T. (2001). Coping with complexity: Educating for capability. BMJ, 323(October), 799–803.
Friedman, B. (1997). Systems Theory. In J. Brandell (Ed.), Theory and practice in social work (pp. 3–17). The Free Press.
Frye, A. W., & Hemmer, P. A. (2012). Program evaluation models and related theories: AMEE Guide No. 67. Medical Teacher. https://doi.org/10.3109/0142159X.2012.668637
Glass, J. M. (2014). Competency based training is a framework for incompetence. BMJ (Clinical Research Ed.), 348, g2909. https://doi.org/10.1136/bmj.g2909
Greenhalgh, T., & Papoutsi, C. (2018). Studying complexity in health services research: desperately seeking an overdue paradigm shift. BMC Medicine, 16(1), 95. https://doi.org/10.1186/s12916-018-1089-4
Haji, F., Morin, M.-P., & Parker, K. (2013). Rethinking programme evaluation in health professions education: Beyond ‘did it work?’ Medical Education, 47(4), 342–351. https://doi.org/10.1111/medu.12091
Hamza, D. M., Ross, S., & Oandasan, I. (2020). Process and outcome evaluation of a CBME intervention guided by program theory. Journal of Evaluation in Clinical Practice. https://doi.org/10.1111/jep.13344
Heywood, L., Gonczi, A., & Hager, P. (1992). A guide to development of competency standards for professions. Canberra.
Hilty, D. M., Chan, S., Torous, J., Luo, J., & Boland, R. J. (2019). A telehealth framework for mobile health, smartphones, and apps: Competencies, training, and faculty development. Journal of Technology in Behavioral Science, 4(2), 106–123. https://doi.org/10.1007/s41347-019-00091-0
Hodges, B. D. (2013). Assessment in the post-psychometric era: Learning to love the subjective and collective. Medical Teacher, 35(7), 564–568. https://doi.org/10.3109/0142159X.2013.789134
Holmboe, E. S., Foster, T. C., & Ogrinc, G. (2016). Co-Creating quality in health care through learning and dissemination. Journal of Continuing Education in the Health Professions, 36, S16–S18. https://doi.org/10.1097/CEH.0000000000000076
Horsley, T., & Regehr, G. (2018). When are two interventions the same? Implications for reporting guidelines in education. Medical Education, 52(2), 141–143. https://doi.org/10.1111/medu.13496
Johnson, C. E., Peralta, J., Lawrence, L., Issai, A., Weaver, F. A., & Ham, S. W. (2019). Focused resident education and engagement in quality improvement enhances documentation, shortens hospital length of stay, and creates a culture of continuous improvement. Journal of Surgical Education, 76(3), 771–778. https://doi.org/10.1016/j.jsurg.2018.09.016
Johnson, J. K., Miller, S. H., & Horowitz, S. D. (2008). Systems-based practice: Improving the safety and quality of patient care by recognizing and improving the systems in which we work. in Henriksen K, Battles JB, Keyes MA, Grady ML, editors. Advances in Patient Safety: New Directions and Alternative Approaches (Vol. 2: Culture and Redesign). Rockville (MD): Agency for Healthcare Research and Quality (US); 2008 Aug. PMID: 21249894.
Kannampallil, T. G., Schauer, G. F., Cohen, T., & Patel, V. L. (2011). Considering complexity in healthcare systems. Journal of Biomedical Informatics, 44(6), 943–947. https://doi.org/10.1016/j.jbi.2011.06.006
Kohn, L. T., Corrigan, J. M., & Donaldson, M. S. (2000). To err is human: Building a safer health system. National Academy Press. https://doi.org/10.1016/s1051-0443(01)70072-3
Leasure, E. L., Jones, R. R., Meade, L. B., Sanger, M. I., Thomas, K. G., Tilden, V. P., et al. (2013). There is no “i” in teamwork in the patient-centered medical home: Defining teamwork competencies for academic practice. Academic Medicine: Journal of the Association of American Medical Colleges, 88(5), 585–592. https://doi.org/10.1097/ACM.0b013e31828b0289
Lingard, L. (2012). Rethinking competence in the context of teamwork. In B. D. Hodges & L. Lingard (Eds.), The Question of competence (pp. 42–70). Cornell University Press.
Love, T., & Burton, C. (2005). General practice as a complex system: A novel analysis of consultation data. Family Practice, 22(3), 347–352. https://doi.org/10.1093/fampra/cmi023
Lucia, A. D., & Lepsinger, R. (1999). The art and science of competency models: Pinpointing critical success factors in organizations. Jossey-Bass/Pfeiffer.
Malone, K., & Supri, S. (2012). A critical time for medical education: The perils of competence-based reform of the curriculum. Advances in Health Sciences Education, 17(2), 241–246. https://doi.org/10.1007/s10459-010-9247-2
Manson, S. M. (2001). Simplifying complexity: A review of complexity theory. Geoforum, 32, 405–414.
Marrelli, A. F., Tondora, J., & Hoge, M. A. (2005). Strategies for developing competency models. Administration and Policy in Mental Health, 32(5–6), 533–561. https://doi.org/10.1007/s10488-005-3264-0
Mennin, S. (2010). Complexity and health professions education. Journal of Evaluation in Clinical Practice, 16(4), 835–837. https://doi.org/10.1111/j.1365-2753.2010.01502.x
Miles, A. (2009). Complexity in medicine and healthcare: People and systems, theory and practice. Journal of Evaluation in Clinical Practice, 15(3), 409–410. https://doi.org/10.1111/j.1365-2753.2009.01204.x
Mylopoulos, M., Kulasegaram, K., & Woods, N. N. (2018). Developing the experts we need: Fostering adaptive expertise through education. Journal of Evaluation in Clinical Practice, 24(3), 674–677. https://doi.org/10.1111/jep.12905
Nelson, E. C., Godfrey, M. M., Batalden, P. B., Berry, S. A., Bothe, A. E., McKinley, K. E., et al. (2008). Clinical microsystems, part 1. The building blocks of health systems. The Joint Commission Journal on Quality and Patient Safety, 34(7), 367–378. https://doi.org/10.1016/S1553-7250(08)34047-1
Norman, G. (2005). Research in clinical reasoning: Past history and current trends. Medical Education, 39(4), 418–427. https://doi.org/10.1111/j.1365-2929.2005.02127.x
Norman, G., Norcini, J., & Bordage, G. (2014). Competency-based education: Milestones or millstones 1 ? Journal of Graduate Medical Education, 6(1), 1–6. https://doi.org/10.4300/JGME-D-13-00445.1
O’Connell, J., Gardner, G., & Coyer, F. (2014). Beyond competencies: Using a capability framework in developing practice standards for advanced practice nursing. Journal of Advanced Nursing, 70(12), 2728–2735. https://doi.org/10.1111/jan.12475
Pask, S., Pinto, C., Bristowe, K., van Vliet, L., Nicholson, C., Evans, C. J., et al. (2018). A framework for complexity in palliative care: A qualitative study with patients, family carers and professionals. Palliative Medicine, 32(6), 1078–1090. https://doi.org/10.1177/0269216318757622
Peters, B. G. (2017). What is so wicked about wicked problems? A conceptual analysis and a research program. Policy and Society, 36(3), 385–396. https://doi.org/10.1080/14494035.2017.1361633
Plack, M. M., Goldman, E. F., Scott, A. R., & Brundage, S. B. (2019). Systems thinking in the healthcare professions: A guide for educators and clinicians. Washington, DC: The George Washington University.
Plsek, P., & Greenhalgh, T. (2001). Complexity science: The challenge of complexity in health care. BMJ, 323(7313), 625–628. https://doi.org/10.1136/bmj.323.7313.625
Plsek, P. E., & Wilson, T. (2001). Complexity, leadership, and management in healthcare organisations four articles. BMJ (Clinical Research Ed.), 323(September), 746–749.
Quinn, J. (1992). Intelligent enterprise: A knowledge and service based paradigm for industry. Free Press.
Regehr, G. (2010). Itâ’s NOT rocket science: Rethinking our metaphors for research in health professions education. Medical Education, 44(1), 31–39. https://doi.org/10.1111/j.1365-2923.2009.03418.x
Rich, J. V., Fostaty Young, S., Donnelly, C., Hall, A. K., Dagnone, J. D., Weersink, K., et al. (2019). Competency-based education calls for programmatic assessment: But what does this look like in practice? Journal of Evaluation in Clinical Practice. https://doi.org/10.1111/jep.13328
Roe, R. (2002). What makes a competent psychologist? European Psychologist, 7(3), 192–202. https://doi.org/10.1027//1016-9040.7.3.192
Rojas, D. (2018). Using systems engineering to inform program evaluation practices in health professions education: Conceptualizing educational programs as socio-technical systems to study system emergence. University of Toronto.
Rojas, D., Grierson, L., Mylopoulos, M., Trbovich, P., Bagli, D., & Brydges, R. (2018). How can systems engineering inform the methods of programme evaluation in health professions education? Medical Education, 52(4), 364–375. https://doi.org/10.1111/medu.13460
Salhi, B. A., Tsai, J. W., Druck, J., Ward-Gaines, J., White, M. H., & Lopez, B. L. (2020). Toward structural competency in emergency medical education. AEM Education and Training, 4(S1), 88–97. https://doi.org/10.1002/aet2.10416
Sargeant, J., Wong, B. M., & Campbell, C. M. (2017). CPD of the future: a partnership between quality improvement and competency-based education. Medical Education. https://doi.org/10.1111/medu.13407
Shepard, K. F., Hack, L. M., Gwyer, J., & Jensen, G. M. (1999). Describing expert practice in physical therapy. Qualitative Health Research, 9(6), 746–758. https://doi.org/10.1177/104973299129122252
Sherbino, J., Bandiera, G., Doyle, K., Frank, J. R., Holroyd, B. R., Jones, G., et al. (2020). The competency-based medical education evolution of Canadian emergency medicine specialist training. CJEM, 22(1), 95–102. https://doi.org/10.1017/cem.2019.417
Street, A. F. (1992). Inside nursing: A critical ethnography of clinical nursing practice (SUNY series, teacher empowerment and school reform). State University of New York Press.
Sturmberg, J. P. (2007). Systems and complexity thinking in general practice. Part 2—Application in primary care research. Australian Family Physician, 36(3), 170–173.
Sturmberg, J. P. (2007a). Systems and complexity thinking in general practice: Part 1—Clinical application. Australian Family Physician, 36(3), 170–173.
Sweeney, K., & Griffiths, F. (Eds.). (2002). Complexity and healthcare: An introduction. Radcliffe Medical Press.
Talbot, M. (2004). Monkey see, monkey do: A critique of the competency model in graduate medical education. Medical Education, 38(6), 587–592. https://doi.org/10.1046/j.1365-2923.2004.01794.x
Taylor, B. (1993). Understand nursing practice. International Journal of Nursing Studies, 30(2), 171–179.
ten Cate, O., & Carraccio, C. (2019). Envisioning a true continuum of competency-based medical education, training, and practice. Academic Medicine, 94(9), 1283–1288. https://doi.org/10.1097/ACM.0000000000002687
Thompson, D. S., Fazio, X., Kustra, E., Patrick, L., & Stanley, D. (2016). Scoping review of complexity theory in health services research. BMC Health Services Research. https://doi.org/10.1186/s12913-016-1343-4
Van Melle, E., Gruppen, L., Holmboe, E. S., Flynn, L., Oandasan, I., & Frank, J. R. (2017). Using contribution analysis to evaluate competency-based medical education programs. Academic Medicine, 92(6), 752–758. https://doi.org/10.1097/ACM.0000000000001479
Varpio, L., Aschenbrener, C., & Bates, J. (2017). Tackling wicked problems: How theories of agency can provide new insights. Medical Education, 51(4), 353–365. https://doi.org/10.1111/medu.13160
Varpio, L., Paradis, E., Uijtdehaage, S., & Young, M. (2020). The distinctions between theory, theoretical framework, and conceptual framework. Academic Medicine, 95(7), 989–994. https://doi.org/10.1097/ACM.0000000000003075
Veen, M., Skelton, J., & de la Croix, A. (2020). Knowledge, skills and beetles: Respecting the privacy of private experiences in medical education. Perspectives on Medical Education, 9(2), 111–116. https://doi.org/10.1007/s40037-020-00565-5
Vollbrecht, M., Biese, K., Hastings, S. N., Ko, K. J., & Previll, L. A. (2018). Systems-based practice to improve care within and beyond the emergency department. Clinics in Geriatric Medicine, 34(3), 399–413. https://doi.org/10.1016/j.cger.2018.04.005
Weis, D. (2000). Use of a taxonomy to describe parish nurse practice with older adults. Geriatric Nursing, 21(3), 125–131. https://doi.org/10.1067/mgn.2000.108259
Weng, H. C., Steed, J. F., Yu, S. W., Liu, Y. T., Hsu, C. C., Yu, T. J., & Chen, W. (2011). The effect of surgeon empathy and emotional intelligence on patient satisfaction. Advances in Health Sciences Education, 16(5), 591–600. https://doi.org/10.1007/s10459-011-9278-3
Whitehead, C. R., Austin, Z., & Hodges, B. D. (2011). Flower power: The armoured expert in the CanMEDS competency framework? Advances in Health Sciences Education Theory and Practice, 16(5), 681–694. https://doi.org/10.1007/s10459-011-9277-4
Whitehead, C. R., & Kuper, A. (2015). Competency-based training for physicians: Are we doing no harm? CMAJ, 187(4), E128–E129. https://doi.org/10.1503/cmaj.140873
Whitehead, C. R., Kuper, A., Hodges, B., & Ellaway, R. (2015). Conceptual and practical challenges in the assessment of physician competencies. Medical Teacher, 37(3), 245–251. https://doi.org/10.3109/0142159X.2014.993599
Wilson, T., Holt, T., & Greenhalgh, T. (2001). Complexity science: Complexity and clinical care. BMJ, 323(7314), 685–688. https://doi.org/10.1136/bmj.323.7314.685
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Batt, A.M., Williams, B., Brydges, M. et al. New ways of seeing: supplementing existing competency framework development guidelines with systems thinking. Adv in Health Sci Educ 26, 1355–1371 (2021). https://doi.org/10.1007/s10459-021-10054-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10459-021-10054-x