A systematic review of influences on implementation of peer support work for adults with mental health problems

Abstract

Purpose

The evidence base for peer support work in mental health is established, yet implementation remains a challenge. The aim of this systematic review was to identify influences which facilitate or are barriers to implementation of mental health peer support work.

Methods

Data sources comprised online databases (n = 11), journal table of contents (n = 2), conference proceedings (n = 18), peer support websites (n = 2), expert consultation (n = 38) and forward and backward citation tracking. Publications were included if they reported on implementation facilitators or barriers for formal face-to-face peer support work with adults with a mental health problem, and were available in English, French, German, Hebrew, Luganda, Spanish or Swahili. Data were analysed using narrative synthesis. A six-site international survey [Germany (2 sites), India, Israel, Tanzania, Uganda] using a measure based on the strongest influences was conducted. The review protocol was pre-registered (Prospero: CRD42018094838).

Results

The search strategy identified 5813 publications, of which 53 were included. Fourteen implementation influences were identified, notably organisational culture (reported by 53% of papers), training (42%) and role definition (40%). Ratings on a measure using these influences demonstrated preliminary evidence for the convergent and discriminant validity of the identified influences.

Conclusion

The identified influences provide a guide to implementation of peer support. For services developing a peer support service, organisational culture including role support (training, role clarity, resourcing and access to a peer network) and staff attitudes need to be considered. The identified influences provide a theory base to prepare research sites for implementing peer support worker interventions.

Introduction

Peer support involves people with lived experience of mental health problems supporting others in their recovery from mental health problems [1,2,3]. Naturally occurring, informal peer support has a very long history [4]. Examples of formal or intentional peer support, in which people with lived experience of mental health problems are employed as peer support workers (PSWs) in mental health services to support others, also extend back as far as the eighteenth century France and the moral treatment era [5]. Peer support promotes person-centred recovery by enabling contact between people with lived experience to foster a sense of connectedness by communicating shared experiences [6,7,8].

Peer support is increasingly being adopted around the world, as an approach to transforming mental health towards a recovery orientation [9]. A focus on recovery involves institutional transformation [10], with more emphasis on shared decision making [11] especially in relation to medication [12], and different approaches to compulsory care [13]. As part of this transformation, some countries such as Australia [14] and the UK [15] now mandate statutory mental health services to involve patients in service development and delivery, and there is increasing uptake of peer support around the world [16, 17]. One role expectation on PSWs is that they be carriers of a recovery culture into mental health systems [18], so introducing PSW roles into services is often challenging [19].

Peer support may not become properly embedded in routine clinical practice if stakeholders are unwilling to integrate it into existing practice or unable to make sense of the information required to operationalise it effectively [20]. Yet, there remain concerns about the organisation and implementation of peer support, with some professionals describing peer support colleagues as increasing workload [21, 22]. A non-systematic review of the barriers to PSW implementation identified a range of challenges, including cultural impediments, poor organisational arrangements, and inadequate overarching mental health policies [23]. Influences which facilitate implementation have not been systematically reviewed. Characterising the barriers and facilitators to PSW implementation would both support the development and rollout at scale of this new role and contribute to the organisational transformation involved in re-orienting services around recovery.

The aim of this systematic review was to identify facilitators and barriers to implementation of formal mental health peer support work.

Method

The review was conducted in the context of the Using Peer Support In Developing Empowering Mental Health Services (UPSIDES) Study, which is a multi-national research study using the Consolidated Framework for Implementation Research [24] to investigate PSW implementation in low-resource setting [25].

Protocol and registration

The protocol of this systematic review was developed in accordance with PRISMA guidelines [26] and registered on PROSPERO (International Prospective Register of Systematic Reviews) on 24 July 2018: CRD42018094838.

Eligibility criteria

Inclusion criteria were: (participants and intervention) studies about PSWs supporting adults 18 aged years or older with a primary diagnosis of mental illness; (outcome) identifies implementation facilitators or barriers for PSW implementation; (study design) randomised controlled trials, controlled before and after studies, cohort studies, case–control studies, cross-sectional studies and qualitative studies. Publications were included if reported in English, French, German, Hebrew, Luganda, Spanish or Swahili (chosen as languages in UPSIDES Study sites), with a date of publication on or before July 2018. Exclusion criteria were: substance misuse or addiction populations; intervention was mutual aid, peer-run organisations, naturally occurring peer support, peer navigation interventions and peer support delivered exclusively online. No studies were excluded on the basis of comparators, control conditions or setting.

Information sources

Six data sources were used: (1) the electronic bibliographic databases (n = 11) searched were MEDLINE (OVID), EMBASE (OVID), Cumulative Index of Nursing and Allied Health Literature (CINAHL) (EBSCHO), PsycINFO (OVID), Scopus, Web of Science, Google Scholar, OpenGrey, ProQuest Dissertations & Theses A&I, African Journals OnLine (AJOL) and Scientific Electronic Library Online (SciELO); (2) table of contents of Psychiatric Services and Psychiatric Rehabilitation Journal (chosen as publishers of PSW studies); (3) conference proceedings of European Network for Mental Health Service Evaluation (ENMESH) (n = 14, 1994–2017) and Refocus on Recovery (n = 4, 2010–2017) (chosen as recovery-relevant academic conferences with available proceedings); (4) websites (peersforprogress.org; cpr.bu.edu) (chosen as they host PSW materials); (5) a preliminary list of included publications was sent to experts (n = 38) requesting additional eligible publications; (6) forward citation tracking on all included records using Scopus and backward citation tracking through a hand-search of reference lists of included publications.

Search strategy

The search strategy was adapted from a published systematic review concerning peer support for people based on statutory mental health services [27]. The search strategy was modified for each database, and an example of the search strategy used for MedLine is shown in Online Resource 1. All searches were conducted from inception until July 2018.

Study selection

After removing duplicates, the titles and abstracts of all identified citations were screened for relevance against the inclusion criteria by DT, with a randomly selected 5% sample independently assessed by RN. Concordance between the two reviewers was 93%. Full texts were single screened by DT. Data extraction was then conducted on 10% of the included publications independently by DT and RN, who discussed their data extraction to check for adequate agreement. Date extraction for the remaining 90% of included publications was then conducted.

Data abstraction

For each included publication, information was extracted on (1) study participant inclusion and exclusion criteria, (2) a summary of the peer support intervention, (3) a summary of the characteristics of the PSW, (4) where the intervention was carried out including country and service setting and (5) factors that influenced implementation, whether the factor enabled or hindered implementation and the evidence that the stated implementation factor influenced implementation.

Quality assessment

The Critical Appraisal Skills Programme (CASP) was used to assess the quality of eligible studies. CASP checklists do not provide an overall scoring, so a scoring system used in a previous systematic review [28] was applied. Each CASP item rated ‘yes’ scored 1 point and each item rated ‘no’ scored 0 points. The percentage score for the 10-item CASP randomised controlled trial checklist, the 10-item CASP qualitative checklist, the 12-item CASP cohort checklist and the 11-item CASP case control checklist was calculated, with studies scoring ≥ 60% graded as good quality, studies scoring 45–59% graded as fair quality and studies scoring below 45% graded as poor [29, 30].

Analysis

A three-stage modified narrative synthesis [31] was conducted on the included papers. In stage 1 (developing a preliminary synthesis), facilitators and barriers to implementation of peer support work identified in included studies were synthesised. Findings were tabulated and an initial coding framework was developed through thematic analysis to group-related facilitators and barriers within overarching themes, called influences. Vote counting of the number of papers identifying each theme was performed to establish the strength of the theme. A preliminary draft of the implementation framework was developed and refined by analysts. In stage 2 (exploring relationships between studies), the implementation influences were compared for studies using a group-based modality (defined as one or more PSWs meeting several service users in a group) versus individual modality (defined as a PSW meeting a service user individually). Stage 3 (assessing the robustness of the synthesis) used two approaches. First, the findings from sub-group analysis of higher quality studies (rated as good) were compared with the framework from all included studies. Second, the identified influences coded in at least 10% of papers were adapted into a measure of PSW implementation readiness. The resulting Implementation Measure, shown in Online Resource 5, comprised eight items, each rated on a four-point scale: 0 (few or no facilitators present, many or all barriers present), 1 (more barriers than facilitators present), 2 (more facilitators than barriers present) or 3 (many or all facilitators present, few or no barriers present). The sum score ranges from 0 (implementation most difficult) to 24. The measure was completed by the site lead in each of the six sites participating in the UPSIDES Study: Ulm (Germany), Hamburg (Germany), Kampala (Uganda), Dar es Salaam (Tanzania), Beer Sheva (Israel) and Pune (India). The sites include low-income (Kampala, Dar es Salaam), lower-middle (Pune) and high-income sites (Ulm, Hamburg, Beer Sheva), and sites with (Hamburg, Kampala, Beer Sheva, Pune) and without (Ulm, Dar es Salaam) experience of implementing peer support work. The goal was to provide preliminary evidence that the synthesis identified influences specific to peer support work (convergent validity) and not to generic influences such as resource level (discriminant validity).

Results

Included studies

The search identified 5813 publications, from which 53 met inclusion criteria. The flow diagram is shown in Fig. 1 and the complete data abstraction table including all references is shown in Online Resource 2.

Fig. 1

Flow diagram of the study selection process

The 53 included publications were conducted exclusively in high-income countries, mainly the USA (n = 30), UK (n = 7), Australia (n = 5), Canada (n = 3) and Republic of Ireland (n = 2), with single studies in Belgium, Germany, Hong Kong, Japan, The Netherlands and one two-country study from Israel and the USA. Designs comprised qualitative studies (n = 38), randomised controlled trials (n = 10), cohort studies (n = 4) and control studies (n = 1). Most included publications did not specify sample size for either PSWs or target clinical population. Studies were rated as good quality (n = 47), fair quality (n = 1) and poor quality (n = 5).

Stage 1 (developing a preliminary synthesis)

The influences identified in all included studies were tabulated and thematically analysed. The full synthesis, including all papers coded to each influence and the strength-of-theme data for each influence, is shown in Online Resource 3. Twelve types of influence, each comprising a set of facilitators and barriers, were identified: organisational culture (coded in 53% of papers); PSW training (42%); PSW role definition (40%); staff willingness and ability to work with PSWs (34%); resource availability (21%); financial arrangements (15%); support for PSW well-being (13%); PSWs access to a peer network (13%); PSW ability to self-manage their own well-being (9%); expectations held by PSWs (6%); organisational processes (6%); and research design needs (2%). The facilitators and barriers for the eight most coded influences are shown in Table 1.

Table 1 Facilitators and barriers to implementation of peer support work

Additionally, two influences were identified for which direction was unclear or the evidence for whether they were facilitators or barriers was conflicting: match between PSW and patient (4%); and emotional intensity in the work (2%).

Stage 2 (exploring relationships among studies)

For the 42 (79%) included studies which stated mode of implementation, 13 (30.9%) were individual, 6 (14. 3%) were group based, and 23 (54.8%) were both individual and group based. Including only the 13 individual PSW studies in the thematic analysis did not lead to deletion of any of the eight strongest themes. However, the ordering changed, with the three strongest themes being ‘organisational culture’, ‘PSW role definition’ and ‘resource availability’. Including only the six group-based PSW studies in the thematic analysis led to deletion of ‘PSW role definition’ and ‘support for PSW well being’ from the framework. The ordering did not markedly change, with ‘organisational culture’ remaining the strongest theme.

Stage 3 (assessing the robustness of the synthesis)

The quality rating for studies is shown in Online Resource 4. Excluding the five studies rated as poor quality and the one study rated as fair quality did not influence the content or strength-of-theme ordering of the narrative synthesis.

The Implementation Measure, shown in Online Resource 5, was based on the most coded influences, shown in Table 1. The resulting eight-item measure (range 0–3 for each item) was rated at each site, and the results are shown in Table 2.

Table 2 Implementation Measure scores at sites (n = 6) varying on income level and PSW implementation experience

No significant floor or ceiling effects were identified: the mean rating per item ranged from 1.2 to 1.7 (scale mid-point 1.5) and each item except item 6 had at least a two-point range in scores. The measure successfully differentiated between sites with a history of PSW implementation (Kampala, Beer Sheva, Hamburg, Pune; mean item score 1.8) and sites without such a history (Dar es Salaam, Ulm; mean score 0.8), providing preliminary evidence of convergent validity. The similar scores for low-income and lower-middle income sites (Dar es Salaam, Kampala, Pune; mean score 1.3) and high-income sites (Beer Sheva, Hamburg, Ulm; mean score 1.5) provide preliminary evidence of discriminant validity.

Discussion

This systematic review and narrative synthesis has identified facilitators and barriers to the implementation of formal peer support work in mental health services. Fourteen types of influence were identified, and scores from a measure based on the most identified eight influences provides preliminary evidence that these influences are specific to peer support work implementation rather than relating to general resource availability.

This review has developed a determinant framework [32], in which facilitators and barriers (determinants) of the implementation of formal peer support work in mental health were identified. Determinants may operate as effect modifiers, mediators or may form links in a chain of causal mechanism [33]. To illustrate, successful PSW implementation may only be possible in services which place value on lived experience as a resource benefiting others [19], but the presence of PSWs in the service supports that change by reducing in-system stigma [34] and ‘them-and-us’ distinctions [35]. So in addition to the direct effectiveness of PSW as an intervention [36], the presence of PSWs influences how other treatments and interventions are provided [37, 38].

The identified influences are consistent with implementation science frameworks. For example, they can be mapped onto the domains of the consolidated framework for implementation research (CFIR) [24], which is a widely used determinant framework to guide implementation [32], and the implementation framework being used in the UPSIDES Study. The CFIR inner setting domain encompasses organisational culture (influence 1 in Table 1), PSW training if provided internally (influence 2), PSW well-being (influence 7); and peer network access if provided internally (influence 8). The CFIR outer setting domain encompasses: role definition if externally defined (influence 3); resource availability (influence 5); financial arrangements (influence 6); and peer network access if provided externally (influence 8). The CFIR individuals domain encompasses staff willingness and ability (influence 4), and the CFIR implementation process domain encompasses PSW role definition if organisationally defined (influence 3) and PSW training (influence 2). Addressing these CFIR domains increases the likelihood of successful implementation [39].

Strengths and limitations

The strengths of this review include the systematic and multi-language search strategy, the robustness of the methodology including quality appraisal and multiple analysts, and preliminary validation of the narrative synthesis through a five-country survey. Several limitations can be identified. First, the exclusion criteria included online peer support studies, which may involve different types of implementation facilitators and barriers, such as technological access. Second, implementation expertise is often gained through experience, so the reliance in this review on published papers could have been supplemented with interviews with a purposive sample of experts. Third, the absence of any identified studies from low-resource settings may reflect the relative difficulty in accessing such reports. A stronger focus on grey literature, widening the inclusion criteria and a wider expert consultation, might have identified reports from lower-income settings, e.g. China [40] and Uganda [41], or related studies such as the ReDeAmericas Program in Latin America (http://www.cugmhp.org/research/redeamericas). Fourth, data extraction was conducted by two analysts on only 10% of included publications, whereas double data extraction is recommended on 100% of included publications [42]. The possibility of publication bias and heterogeneity in included papers are also limitations. Fifth, included publications were not analysed by diagnosis of PSW or target population, since peer support is a transdiagnostic intervention [43]. Finally, whilst strength of theme was used to order the identified influences, the magnitude and mechanisms of each influence were not investigated. So whilst organisational culture was the most identified influence, it may be that other influences have a greater impact on implementation, or that sub-levels of organisations (e.g. team, service, leadership etc.) exert different types of influence on implementation.

Implications for practice and research

The identified influences provide a theoretical foundation to guide PSW implementation in new settings. The Implementation Measure was shown to be usable in both lower- and higher-income countries, and to differentiate between sites with and without PSW implementation experience. The Implementation Measure can therefore be provisionally recommended for two uses.

First, for clinical services intending to implement a new PSW service, it provides a synthesised set of influences to address as part of the service development. In addition to the substantial evidence about PSW effectiveness [27, 44], there is emerging economic evidence supporting PSW implementation [45] and preliminary evidence that PSW services create a social return on investment [46]. Implementation in new clinical services is therefore likely to increase. The Implementation Measure as well as more locally developed approaches, such as the Team Recovery Implementation Plans (TRIP) approach developed in England [47], identifies the key influences to target. The most identified influence was organisational culture, and this is an international challenge [48]. Evidence-based approaches are emerging to change organisational culture, including a greater emphasis on supporting strengths [49,50,51], self-management [52], hope [53, 54], well-being [55,56,57] and more use of new interventions such as positive psychology [58, 59], recovery colleges [60,61,62] and a greater focus on human rights [63]. New measures to evaluate recovery-related outcomes are also becoming available [64, 65].

Second, the Implementation Measure can be used in research to inform the implementation strategy for manualised PSW interventions. This is the approach being taken in the UPSIDES Study, in which the quantitative Implementation Measure score and focus group data are being integrated to develop a detailed situation analysis, to inform the implementation approach to be used in each site [25]. Maximising the presence of facilitators and addressing barriers will support effective and sustainable PSW implementation in a range of settings.