Abstract
Background
Establishing a workforce capable of meeting population needs is contingent on evaluation that can inform sound policy and planning. Health workforce evaluation has traditionally relied on health labour market analysis and workload estimations. To date, competency analysis has not been included in national health workforce evaluation, despite that fact that the findings may go far in guiding decisions around workforce composition, optimisation and education and training. This case study sought to assess the feasibility and perceived added value of integrating competency analysis into national rehabilitation workforce evaluation, and to determine how competency analysis can shape rehabilitation workforce planning. The findings of the case study can be used to explore the integration of competency analysis in the evaluation of other health-related occupational groups.
Methods
Participant observation was complemented by key informant interviews with experts engaged in the national rehabilitation workforce evaluation in Poland. These experts represented stakeholders in policy, education, research, clinical practice and professional associations.
Results
The results indicated that competency analysis can be feasibly integrated into national rehabilitation workforce evaluation, particularly when implementation is supported through the use of online platforms. However, the collection of additional data using other tools, such as a survey of the behaviours and tasks of a wider sample of rehabilitation workers, could strengthen data reliability. Experts perceived findings of the competency analysis to be valuable for expanding the understanding of rehabilitation, shedding light on task allocation and deployment of the existing rehabilitation workforce, and advocating for the rehabilitation workforce to be strengthened, especially in relation to those occupations which may not be recognised or valued as rehabilitation workers. Although it was not possible to fully explore the impact of competency analysis data on rehabilitation workforce planning and development in this study, experts suggested that its availability would likely foster greater cooperation among occupations, which has been missing at the policy and planning level to date. It further demonstrates what competency data should be collected and reported, and provides richer information to guide decisions.
Conclusions
Competency analysis complements traditional labour market analysis and workload estimates, adding depth to the understanding of how members of the workforce perform and perceive themselves, and how deficiencies in the workforce impact on the provision of care to specific population groups.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Introduction
In 2021, the World Health Organization launched the Rehabilitation Competency Framework (RCF), which describes the competencies and activities of the rehabilitation workforce [1]. The framework is relevant to all occupations that deliver care that aims to optimise functioning and reduce disability. It crosscuts specialisations and settings, and is, therefore, capable of being adapted and adopted for application in any specific context [2]. In its original form, the RCF provides a unique opportunity to conduct a competency analysis of the rehabilitation workforce. This has not previously been possible due to the absence of: (1) a shared description of proficiency levels that spans the spectrum of qualifications and expertise encompassed within the rehabilitation workforce; and (2) a comprehensive list of tasks that indicate the scope of rehabilitation care delivered by the rehabilitation workforce collectively. The RCF addresses both these barriers, opening the door to a new level of workforce evaluation extending beyond that of traditional health labour market analysis (HLMA).
Methods
Study design
This study employed participant observation methodology, whereby two researchers (authors JM and WK) were immersed in the pilot, enabling them to interact with the GRoWE resources and experience each step of implementation. The authors further observed the time taken to complete the different competency analysis exercises, the challenges experienced by the stakeholders completing the exercises, how the findings were reported and how they were interpreted and applied in rehabilitation workforce planning.
Key informant interviews were also conducted with experts engaged in the evaluation, including those working in policy, education, professional associations and clinical practice. Lines of enquiry explored stakeholders’ experiences in identifying and reporting data, their perception of the findings and their added value, as well as their recommendations for future evaluations.
Study population
This study draws on the insights of the following stakeholders:
-
The WHO personnel overseeing the development and piloting of GRoWE (JM)
-
The project officer responsible for implementing GRoWE in Poland (WK)
-
Experts engaged in the evaluation (n = 5). The demographic profile of the experts is presented in Table 2.
Recruitment
The GRoWE project officer (WK) disseminated an invitation to participate in feedback interviews via email to the experts who had engaged in the evaluation. The email included a participant information sheet (translated into Polish) and a link to a survey which showed the times available for interviews, and asked if interpretation would be needed. Participants interested in being interviewed were directed to complete the form and contact the WHO focal point (JM), who provided a consent form (also translated into Polish) and confirmed the time of the interview.
The relatively small sample of key informants partly reflects the challenges associated with recruiting individuals who are typically time-poor as well as the size (n = 42) of the pool of potential interviewees (i.e., experts who had participated in the evaluation). Nonetheless, the sample represented a wide range of perspectives, including policy makers, researchers, educators, practitioners, and leaders of professional associations. Finally, the themes emerging from analysis of the data achieved saturation, suggesting that additional interviews would not have generated new insights.
Data collection
Key informant interviews were conducted by the WHO focal point and were recorded and transcribed using Microsoft Teams. Interpretation was offered to all key informants, but was only partially used by two, predominantly when technical language was being used. Transcripts were manually cleaned for analysis. Data from the participant observation were gathered through a systematic debriefing between the WHO focal point (JM) and GRoWE project officer (WK). The debrief involved detailed, goal-focused discussion, framed around the topics of engagement, feasibility, perception, added value and additional lessons learned. The data from the debrief were compared with the findings from the key informant interviews and the results of the competency analysis. These triangulated data were discussed by all authors of this paper.
Data analysis
Thematic analysis of the interview transcripts was performed using NVIVO software. Results of the thematic analysis were reviewed and agreed by all authors and compared with observational findings.
Ethical approval
Ethical approval for this study was obtained from the Human Research Ethics Committee of The University of Sydney, Australia (project number 2021/824).
Results
Analysis of the data from the key informant interviews and project officer debrief revealed several themes related to the perceived value of the competency analysis, as well as of the evaluation more broadly. Themes also emerged around challenges experienced with data collection and quality, and several experts offered suggestions for strengthening future implementation of the evaluation. The main themes are elaborated below. Note that key informants and the project officer are referred to as “experts”.
Working with the concept of a rehabilitation workforce
GRoWE was designed as a resource for the rehabilitation workforce collectively, rather than for any specific occupation. This was reflected in the competency analysis in particular, which presented rehabilitation assessments and interventions targeting a range of areas of functioning (e.g., mobility, communication, respiration, mental health.). Experts reported that participating in an evaluation that adopted the concept of a “rehabilitation workforce” challenged the identity of some occupations and expanded stakeholders’ understanding of what rehabilitation is and what its workforce comprises. For example, many speech and language therapists, who in Poland work primarily in the education sector, had not considered themselves as health workers or as rehabilitation workers. Conversely, psychologists in Poland had been working hard to promote themselves as rehabilitation professionals, but had encountered challenges due to the narrow perception of rehabilitation in the country. Experts noted that rehabilitation is largely synonymous with physiotherapy and rehabilitation medicine in Poland, and that other occupations, especially those which do not primarily address ‘physical’ impairment, are overlooked. The GRoWE project officer noted, “There are two queens or kings—doctors and physiotherapists—and the rest are underestimated”. GRoWE challenged this perception, placing equal importance on the competencies and tasks of each occupation included in the evaluation.
Identifying and managing scopes of practice
The competency analysis was reported by experts to be valuable in addressing the issue of informal task sharing. Task sharing was noted to be widespread among the rehabilitation workforce in Poland, especially in relation to physiotherapists absorbing tasks from the scopes of practice of occupational therapy and speech and language therapy. Task sharing was considered to be necessary in Poland given the underdevelopment of many of the rehabilitation occupations but was not always well-supported with education and training. Furthermore, it was suggested, physiotherapists tended to assume that they were responsible for all or most rehabilitation tasks—a belief that likely stems from the absence of other occupations in many settings. As one expert reported, “we need to make the space for [other occupations], because sometimes physiotherapists here in Poland are thinking that they are all in one, but we are not” (KI5).
The competency analysis was considered by experts to be useful in showing which occupations were working at what level and what tasks were being performed by whom. This was seen as central to ensuring “proper use of available workforce” (KI2). Despite some limitations in the competency analysis (see data collection and quality below), the results were seen by experts as an important starting point for discussion and as the basis for the development of more comprehensive competency analysis tools.
Multidisciplinary collaboration
A perceived benefit of GRoWE in general and the competency analysis exercises in particular was its ability to foster collaboration between the different rehabilitation occupations. Experts noted that, although some occupations were accustomed to working together in the clinical setting, this rarely translated into cooperation in workforce evaluation and planning. Completion of the exercises necessitated teamwork, while the workshops brought all occupations together around a virtual table, with a common aim. Experts noted that this had previously been lacking. One expert stated, “I was missing this openness and the willingness to cooperate between the different sections of the rehabilitation system. Therefore, it was perfect for me” (KI5).
Data collection and quality
All experts noted challenges with data collection and quality. These related to all aspects of the evaluation, but reliability was specifically flagged as a concern for the competency analysis. This concern was linked to the subjective nature of the competency analysis exercises, which relied on a small sample of workers reporting on behalf of their wider occupation. The project officer reported that some stakeholders felt uncomfortable with the responsibility of representing their workforce. For example, when completing the competency analysis exercises, participants reported tension between responding based on what is expected of the occupation and the actual performance of workers. While the instruction for the exercises was to report actual performance, it was not always possible for the sample of workers completing the exercise to gauge this. Concerns about reliability were greater for unregulated occupations, such as occupational therapy, for which there is considerable variability in levels of proficiency and scopes of practice. Given these concerns, experts felt that the results of the competency analysis should be interpreted as preliminary and used to facilitate further investigation. It was also suggested that a survey instrument and/or focus groups could be used in addition to the exercises to obtain a wider range of perspectives and opinions, thereby strengthening the reliability of the data.
As the GRoWE pilot in Poland took place in the context of the COVID-19 pandemic, stakeholders had to meet virtually, and data collection occurred via emails, phone calls and online meetings and workshops. This format was considered by the experts to have several benefits, including greater flexibility and the ability to engage stakeholders from different geographic regions of the country. The GRoWE project officer noted however, that face-to-face discussion among stakeholders, even in a single workshop, had the potential to strengthen stakeholder engagement with the evaluation. Meeting in person was thought to enable better communication and connection among stakeholders (especially those who had not known each other prior to the evaluation) and between stakeholders and the project officer, to whom data were reported. Experts tended to agree that a hybrid approach would be optimal, with online communication complemented by at least one in-person workshop.
Discussion
Traditionally, health workforce evaluation has focused on labour market analysis. The present study is the first to examine how competency analysis can complement labour market analysis in the context of national workforce planning for rehabilitation. To date, the application of competency analysis has been limited to the evaluation of specific workforce contexts, such as emergency preparedness or optimising the nursing and midwifery workforce in low-resource countries. Specifically, this study aimed to assess the feasibility, perceived added value of integrating competency analysis into national rehabilitation workforce evaluation, and its ability to shape rehabilitation workforce planning. These questions were examined in the context of the pilot of GRoWE in Poland, during which participant observation was conducted by the GRoWE project officer and the WHO focal point, and key informant interviews were conducted with experts engaged in the evaluation. Analysis of the triangulated data indicated that such integration was feasible and that it added considerable value to the rehabilitation workforce evaluation.
Feasibility
The expansion of platforms for online working and the increased familiarity with remote working associated with the COVID-19 pandemic enabled GRoWE to be implemented virtually. This greatly enhanced its feasibility, allowing stakeholders from different parts of the country to engage and minimising the disruption to their regular work. However, a hybrid approach, whereby at least one workshop is held in person, is likely to be optimal as it will provide an opportunity to complete more challenging analysis exercises in the presence of the project officer. In-person workshops will further strengthen GRoWE’s role in fostering relationships among stakeholders, especially those from different occupations, and build greater rapport between the stakeholders and project officer, which may help to sustain their participation throughout the evaluation. Such a hybrid approach was adopted with great success in other pilots of GRoWE that were conducted in Rwanda and Nepal after the pilot in Poland had commenced. These additional pilots also demonstrated that the ideal balance between in-person and virtual working is context-dependent and is influenced by what is considered culturally appropriate and the availability and uptake of the required technology.
The method of using a small representative sample of workers from each occupation was initially adopted by GRoWE to address the challenges associated with coordinating large groups of people to complete shared exercises and achieve consensus. Although this approach enhanced the feasibility of the competency analysis, it reduced the reliability of the data for occupations with a large workforce. This may not be of concern when GRoWE is implemented in countries with a much smaller supply of rehabilitation workers, where a sample of 5 workers may represent 25% or more of the occupation. When this is not the case, the use of additional data collection instruments to obtain input from a wider range of perspectives would be valuable. A survey instrument could be developed to complement the existing analysis exercises and serve to verify their findings.
In summary, the use of virtual meeting platforms and the ability to use samples of workers to represent each occupation made the integration of competency analysis in Poland’s evaluation of the rehabilitation workforce feasible and suggests that it could be used in other countries and possibly with other occupational groups. However, the resource requirements and logistical burden of conducting the competency analysis exercises need to be acknowledged, and necessitate a commitment to using the findings to further develop the workforce.
Perceived added value
In this case study, the competency analysis complemented traditional labour market data in several ways. First, from a practical perspective, the competency analysis data provided information on task allocation and worker proficiency that can guide action in education and inform decisions and practices around task sharing, which are critical in a country without an adequate supply of workers. Second, through participating in the competency analysis exercises, stakeholders became aware of the concept of a rehabilitation workforce and the broader scope of rehabilitation interventions. As such, the competency analysis exercises served as mechanisms for education and advocacy. This was particularly significant for occupations, such as occupational therapy, speech and language therapy and clinical psychology, who are less likely than physiotherapists or physical and rehabilitation medicine doctors to be seen or valued as rehabilitation workers, despite their unique and critical contributions. Third, the competency analysis identified the kinds of data that are important to collect and report, or routinely explore. This may help to improve future data collection practices beyond the evaluation itself.
Impact on rehabilitation workforce planning
It remains to be seen what impact the competency analysis data will have on rehabilitation workforce planning in the months and years ahead. However, experts believed that both the process and results of the analysis will strengthen planning and development by: fostering cooperation between different occupations, which has heretofore rarely occurred at a policy and planning level; identifying the types of data that are important to collect and report; and providing information about the allocation of tasks and proficiency of workers. The latter may also help guide the design and delivery of rehabilitation workforce education in the country by highlighting possible areas of underperformance and areas for interdisciplinary training to facilitate task sharing.
Limitations
This study captured the findings from only one pilot of GRoWE, which was conducted in a high-income country. However, the feasibility of the competency analysis, the extent to which it is valued and its impact on planning may differ from country to country. The results of this pilot should, therefore, be interpreted with caution, and lessons should continue to be drawn from the further implementation of GRoWE in future.
Conclusion
Competency analysis appears to be a valuable addition to labour market analysis for evaluating the rehabilitation workforce. The approach is of potential interest to other health-related occupational groups, such as the vision or hearing workforce, which comprise a number of occupations that make unique but interrelated contributions to patient care. Competency analysis in the context of national workforce evaluation is a novel practice and, while it is an exciting innovation, its application should be approached with an openness to learning and adaptation.
Availability of data and materials
Raw data from the key informant interviews are confidential and will not be disclosed. Raw competency data from the case study may be released at the Polish Ministry of Health’s discretion. The Guide for Rehabilitation Competency Framework, is available via https://www.who.int/teams/noncommunicable-diseases/sensory-functions-disability-and-rehabilitation/guide-for-rehabilitation-workforce-evaluation. Contact millsj@who.int for enquiries regarding data and material access.
Abbreviations
- GRoWE:
-
Guide for rehabilitation workforce evaluation
- HLMA:
-
Health labour market analysis
- RCF:
-
Rehabilitation Competency Framework
- WHO:
-
World Health Organization
References
World Health Organization. Rehabilitation Competency Framework. Geneva: World Health Organization; 2021.
Mills J-A, Cieza A, Short SD, Middleton JW. Development and validation of the WHO Rehabilitation Competency Framework: a mixed methods study. Arch Phys Med Rehabil. 2021;102(6):1113–23.
Bickenbach J, Sabariego C, Stucki G. Beneficiaries of rehabilitation. Arch Phys Med Rehabil. 2021;102(3):543–8.
Boggs D, Polack S, Kuper H, Foster A. Shifting the focus to functioning: essential for achieving Sustainable Development Goal 3, inclusive Universal Health Coverage and supporting COVID-19 survivors. Glob Health Action. 2021;14(1):1903214.
Stucki G, Bickenbach J, Gutenbrunner C, Melvin J. Rehabilitation: the health strategy of the 21st century. J Rehabil Med. 2018. https://doi.org/10.2340/16501977-2200.
Bright T, Wallace S, Kuper H. A systematic review of access to rehabilitation for people with disabilities in low- and middle-income countries. Int J Environ Res Public Health. 2018;15(10):2165.
Kamenov K, Mills JA, Chatterji S, Cieza A. Needs and unmet needs for rehabilitation services: a scoping review. Disabil Rehabil. 2019;41(10):1227–37.
Jesus TS, Hoenig H. Crossing the global quality chasm in health care: where does rehabilitation Stand? Arch Phys Med Rehabil. 2019;100(11):2215–7.
Commission on Health Employment and Economic Growth. Working for health and growth: investing in the health workforce. Report of the High‐Level
World Health Organization. Commission on health employment and economic growth. Geneva: World Health Organization; 2016.
Coates A, Fuad A-O, Hodgson A, Bourgeault IL. Health workforce strategies in response to major health events: a rapid scoping review with lessons learned for the response to the COVID-19 pandemic. Hum Resour Health. 2021;19(1):154.
World Health Organization. Guide for rehabilitation workforce evaluation. Geneva: Publication pending; 2023.
Campbell J, Mills J-A. Health systems and policy research needed to strengthen the rehabilitation workforce. Bull World Health Organ. 2022;100(11):747–8.
Acknowledgements
The authors express their gratitude to the stakeholders that participated in the pilot of GRoWE in Poland, and in particular to those that shared their experiences and feedback during the interview process.
Funding
Funding for the GRoWE pilot in Poland was provided by USAID.
Author information
Authors and Affiliations
Contributions
J-AM: led the development of GRoWE and oversaw the pilot of GRoWE in Poland; obtained ethical approval for the study; conducted key informant interviews; drafted the manuscript. WK: project officer for GRoWE in Poland (led data collection and compilation), assisted with recruitment of participants for key informant interviews, participated in the case study debrief; provided feedback on drafts of the manuscript. AC, PZ, SDS, and JWM: oversaw the development of GRoWE and provided feedback on drafts of the manuscript. PC: oversaw the pilot of GROWE in Poland and provided feedback on drafts of the manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Ethical approval was granted by the Research integrity and Ethics Administration, Human Research Ethics Committee, The University of Sydney on 20 December 2021 (Project no. 2021/824). Prior to participating in key informant interviews, participants were provided with information sheets and consent forms, both translated into Polish. Signed consent forms were collected prior to interviews commencing.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Annex
Annex
Overview of task mapping findings and key conclusions of the competency analysis
Overview of findings from the task mapping
Gaps in the delivery of rehabilitation assessments and interventions
The task mapping identified potential gaps of concern in the assessment of:
-
cognitive impairment
-
swallowing and salivation impairment
-
hearing impairment
-
fatigue
-
performance of activities and participation in the home, education and work environment.
Gaps were also identified in the ability to deliver the following rehabilitation interventions:
-
environmental modifications to home, school and workplace
-
educating and supporting teachers, classmates and employers
-
airway clearance techniques
-
community mobility interventions (e.g., navigating transportation)
-
speech and language interventions
-
interventions for pain
-
interventions for sexual functions and intimate relationships
-
interventions for addressing activities and participation, such as self-care interventions and vocational training.
Gaps were further identified in provision and training in the use of assistive products for sensory impairments, such as:
-
hearing aids
-
Braille displays and writing equipment
-
screen readers
-
gesture to voice technology
-
deaf-blind communicators and communication software.
These assessments and interventions are considered essential in the rehabilitation care of persons with health conditions that are widely prevalent and/or have a profound impact on functioning. As such, their absence is associated with significant unmet needs, resulting in reduced functioning and participation in education, work and community life.
Overlaps in the delivery of rehabilitation assessments and interventions
It is not uncommon, nor necessarily problematic, for there to be a degree of overlap in the provision of certain rehabilitation assessments and interventions. However, overlaps in scopes of practice that develop unintentionally over time can, if not systematically considered, result in inefficiencies. In other instances, it may be beneficial to introduce further overlap in scopes of practice to compensate for a particularly severe shortage of an occupational group.
In this study, the identification of overlaps was complicated for two main reasons. First, prosthetists and orthotists in Poland come from a range of backgrounds, and thus do not have a uniform scope of practice. Second, the profession of occupational therapy is still unregulated, again resulting in variability in scopes of practice. Nevertheless, the task mapping identified several areas of overlap that warrant exploration, as well as interventions that could potentially be expanded into an alternative occupation’s scope of practice to ensure they are available to those who need them.
Existing overlaps warranting exploration include, but are not limited to:
-
mobility assessments
-
assessment of the environment (home, school and workplace)
-
the provision of mobility aids (such as wheelchairs, crutches, walking canes and walking frames), grab bars and compression garments.
Key conclusions drawn from the findings of the competency analysis
-
1.
There are competency gaps in the rehabilitation workforce, particularly in the domains of Learning and Development, Management and Leadership, and Research. This indicates scope for strengthening in education and training.
-
2.
There is inconsistency in competency levels both within and between rehabilitation occupational groups, reflecting differences in education and training and inadequate development and verification of competency standards.
-
3.
There is a lack of evidence-based practice in the rehabilitation workforce, driven by a lack of investment in research skills, lack of access to and poor use of clinical guidelines and protocols, and limited mechanisms for knowledge sharing and promotion.
-
4.
Rehabilitation workers lack adequate access to supervision, support and mentorship, including from peers, particularly for those working in more remote contexts. This hinders the development of the emerging workforce and potentially compromises patient safety.
-
5.
There are inadequate opportunities for sub-specialisation, particularly for occupational therapists, which limits the ability of the rehabilitation workforce to meet more complex patient needs.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Mills, JA., Krzepkowska, W., Cieza, A. et al. Integrating competency analysis into national rehabilitation workforce evaluation: a case study. Hum Resour Health 21, 69 (2023). https://doi.org/10.1186/s12960-023-00843-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12960-023-00843-3