Abstract
Background
Social integration, shared decision-making and personalised care are key elements of mental health and social care policy. Although these elements have been shown to improve service user and service-level outcomes, their translation into practice has been inconsistent and social isolation amongst service users persists.
Aim
To co-adapt, with service users, carers/supporters and health professionals, a web-based social network intervention, GENIE™, for use in secondary mental health services. The intervention is designed to support social activity and preference discussions between mental healthcare professionals and service users as a means of connecting individuals to local resources.
Methods
In Phase 1 (LEARN), we completed two systematic reviews to synthesise the existing evidence relating to the i) effectiveness and ii) the implementation of social network interventions for people with mental health difficulties. We undertook semi-structured interviews with a convenience sample of 15 stakeholders previously involved in the implementation of the intervention in physical healthcare settings. Interviews were also conducted with 5 national key stakeholders in mental health (e.g., policy makers, commissioners, third sector leads) to explore wider implementation issues.
In Phase 2 (ADAPT), we worked iteratively with eight service users, nine carers, six professionals/volunteers and our patient and public advisory group. We drew on a framework for experience-based co-design, consisting of a series of stakeholder consultation events, to discuss the use of the social network intervention, in mental health services. Participants also considered factors that could serve as enablers, barriers, and challenges to local implementation.
Results
Across the stakeholder groups there was broad agreement that the social network intervention had potential to be useful within mental health services. In terms of appropriate and effective implementation, such an intervention was predicted to work best within the care planning process, on discharge from hospital and within early intervention services. There were indications that the social connection mapping and needs assessment components were of most value and feasible to implement which points to the potential utility of a simplified version compared to the one used in this study. The training provided to facilitators was considered to be more important than their profession and there were indications that service users should be offered the opportunity to invite a carer, friend, or family member to join them in the intervention.
Conclusion
The GENIE™ intervention has been co-adapted for use in mental health services and a plan for optimal implementation has been co-produced. The next phase of the programme of work is to design and implement a randomised controlled trial to evaluate clinical and cost effectiveness of a simplified version of the intervention.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
Mental health difficulties are highly prevalent with long-lasting impacts. Approximately 2.8 million people were in contact with adult mental health and social care services in the UK in 2020/2021 [1]. There are more disability-adjusted life years lost per year to mental health difficulties than any other health condition in the UK, including cancer and heart disease [2].
Involving service users in decision-making around their care, offering treatment choices and promoting recovery are central aspirations of contemporary mental health and social care policy initiatives and quality improvement guidance [3]. The 5-year plan by the Mental Health Taskforce is an example in a series of government mandates advocating for service user and carer focused interventions [4, 5]. This upholds shared decision-making and personalised care as guiding principles of mental health service design and delivery [3]. In direct response to these reports, the Government has pledged to provide more personalised and integrated care to people experiencing severe and/or enduring mental health difficulties [6].
Social networks constitute a set of connections and ties, linking people to relationships and resources which can support them to manage their mental health. Social networks have been found to positively influence recovery for people with severe and/or enduring mental health difficulties [7]. Social connectivity and valued activities have been found to be important in recovering and living everyday life with a mental health problem [8]. However, it has also been demonstrated that people with severe and/or enduring mental health difficulties have smaller social networks of poorer quality [9,10,11]. Therefore, enabling patient activation and improving social integration are necessary components of providing community-based support for people with mental health difficulties. Recent evidence for this population concluded that social networks mediate the effects of social isolation and loneliness and enhance self-management [7, 12, 13]. Furthermore, social relationships have been identified as key mechanisms for behaviour change in strengths-based mental health and social care interventions [14].
Social network interventions which connect people to meaningful and valued activities in domestic and local environments can improve the size and quality of social networks and their collective efficacy [15, 16]. In doing so, they extend access to sources of support that can help to both prevent and manage mental health difficulties [17]. This approach has been shown to be successful for a range of long-term physical health conditions [18, 19] but has been slow to translate to mental health care [20]. However, social connectedness to assist recovery requires navigation, eliciting preferences and engagement by both individuals seeking assistance and those involved with mental health work designated with a supportive and therapeutic role [21].
Social network interventions offer the advantages of strengths-based perspectives. These are approaches which emphasise the mapping of assets individuals have at their disposal (e.g. in the community) as a means of engaging people to talk about their social situation and community [22]. In turn in a mental health service setting these can open up new conversations and dialogue about personal experience and everyday living. This fits with essential elements of the recovery processes identified by Leamy et al. (2011) of: connectedness; hope and optimism about the future; identity; meaning in life; and empowerment and collectivist notions of recovery [23].
A social network intervention
GENIE™ provides an exemplar of an evidence-based networking tool designed to help people identify and reflect on existing networks as a starting point from which to extend and suggest further connection and engagement with local and online resources. It also helps people to extend networks by facilitating resource navigation and linking people to additional resources (people, social activities, pets, things) and thus to support that individuals experience as valuable, acceptable and supportive [24].
It comprises three steps: a) network-mapping and visualisation for reflexive engagement b) identification of gaps and preferences for social support and engagement, and c) facilitated navigation of online and offline resources based on individual preferences, and involvement of other social network ties.
Mapping social networks provides professionals and service users with a visual representation and means of thinking about the quality of contact with others and social activities that people currently have. It brings into focus what other network engagement may be available and accessible to them. Users receive visual feedback through a pictorial map of their network. Finally, the preferences for new activities are elicited and discussed in the context of information on local community resources to attend or engage with possibly with the help of existing network members to facilitate engagement (via Google maps) (Additional file 1: Appendix 1).
GENIE™ has an existing evidence base to support its utility for adults living with a range of long-term physical health conditions (e.g. chronic obstructive pulmonary disease, diabetes, and early stage chronic kidney disease) which demonstrates a positive impact on some mental and physical health indicators, quality of life and relationships, and connection to the local community with potential for cost containment within the NHS [19, 25]. In terms of feasibility and usability, previous research suggests that in using this tool clinicians strengthened their understanding of patients’ personal social networks and needs, and patients reported less social isolation [26]. Its use has shown to be enhanced when supported by volunteers to expand patients’ social networks and link them to relevant health and social care resources [26]. The intervention operates through the disruption and reconstruction of social networks, challenging/supportive facilitation and change and reflection over time concerning network support. Visualisation of the network enables people to mobilise support and engage in new activities. The tool works best when it is aligned synergistically to a facilitators’ role of linking people to local resources [24].
However, this social network intervention has not yet been used within mental health services. Given the relevance of recognising the impact of context on the workability of social network interventions, the potential differences in the experience, trajectory and marginalisation of mental health conditions compared with physical health conditions [27], the intervention needs to be robustly explored and adapted for use in mental health services.
Our study, The Co-Adaptation of a Social Network Intervention to Support Recovery for People living with Severe Mental Illness (ConNEct) aimed to co-adapt, a web-based social network intervention which was designed to support discussions between mental healthcare professionals and service users about their care and connect these individuals to local resources.
Objectives
-
1.
To develop an in-depth understanding of the potential role of a social network intervention (GENIE™) within mental health services, from the perspective of service users, carers/supporters, and mental health professionals.
-
2.
To identify the individual and organisational barriers and facilitators to the use of social network interventions in mental health settings.
-
3.
To co-adapt with service users, carers/supporters and professionals a social network intervention for testing and evaluation in secondary mental health services.
-
4.
To develop a model of implementation, including specific determinants of success informed by recent evidence and implementation theory and the perceptions of service users, clinicians, and other key stakeholders.
Patient and public involvement (PPI)
PPI has been an essential component of the current study and has included the recruitment of a co-applicant and researcher with lived experience of severe and/or enduring mental health difficulties, a PPI advisory group and consultation workshops with mental health service users, carers/supporters, and clinicians/volunteers. The advisory group met quarterly, and its role was to provide advice and guidance to the research team drawn from lived experience of mental health difficulties and secondary care services, in a variety of ways including the development of research materials and recruitment processes, developing patient-mediated materials, contributing to the systematic review, inputting into data analysis, co-authoring publications and supporting the dissemination of study findings.
Methods
The study was informed by the Medical Research Council’s Framework for Developing and Evaluating Complex Interventions [28, 29] and comprised two distinct but interrelated phases: Phase 1 LEARN and Phase 2 ADAPT.
Phase 1: LEARN
Phase 1 involved undertaking a needs assessment which included two systematic reviews and qualitative interviews with people who have previously used GENIE™ in physical health and community settings and those involved nationally in mental health policy and practice.
Systematic reviews
Two systematic reviews were undertaken to provide an up-to-date synthesis of evidence relating to the effectiveness (review 1) and implementation (review 2) of social network interventions for people with mental health difficulties.
Review questions
Review 1:
-
What is the effectiveness of interventions designed to improve the quantity and/or quality of social networks of adults with mental health difficulties?
-
What are the factors that influence the effectiveness of social network interventions for people with mental health difficulties?
Review 2:
-
For people with mental health difficulties, what social network interventions work best, for whom and in what contexts?
-
What are the barriers to and facilitators of the implementation of social network interventions for people with diagnosed mental health conditions?
Methods
Review 1: Articles were eligible for inclusion if they reported data from randomised controlled trials (RCTs) on the effectiveness of interventions designed to improve social networks for adults (18+) with mental health difficulties. Papers were independently reviewed for inclusion with conflicts resolved through consensus. Included papers were quality-assessed, relevant data were extracted, and synthesised narratively. Risk of bias was assessed using the Cochrane Risk of Bias Tool [30]. Due to the heterogeneity of included studies, it was not possible to undertake a meta-analysis and a narrative synthesis was conducted.
Review 2: Journal articles or dissertations with primary data on the implementation of interventions designed specifically to improve and/or measure social network quantity and/or quality for adults (18+) with mental health difficulties were included in this review. All types of study design were included. Papers were independently reviewed for inclusion with conflicts resolved through consensus. Included papers were quality-assessed, data-extracted, and synthesised narratively. Analysis had a specific focus on identifying the relevant mechanisms and how they work in different contexts, with the aim of developing a deeper understanding and to allow theory-building. The Mixed Methods Appraisal Tool (MMAT) [31] was used to assess the quality of the included papers as it was devised for a broad range of research, as arose in this review.
Further detail on the methods and results of these systematic reviews are available separately [20]. Review 1: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=206490. Review 2: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=206423.
Qualitative interviews
Design
A qualitative, exploratory design was used to elicit current understanding of the design and use of the intervention in mental health services. We undertook semi-structured interviews with multiple stakeholders who have previously used GENIE™ across a range of service settings. Such methods are recommended to fully understand the complexities and nuances of potential implementation [29]. Interviews were also undertaken with national key stakeholders involved in social networks and mental health (e.g. policy makers, commissioners, third sector leads and additional key influencers) about wider implementation issues [32].
Participants
A database of potential participants for both the previous users of GENIE™ and the national key stakeholders was compiled by the study team and this was combined with the use of snowballing sampling techniques [33], whereby interviewees were asked to nominate other people who may also meet inclusion criteria.
Potential participants received a direct invitation by email from the study team which included a study participant information sheet. Participants had the opportunity to ask questions before a mutually convenient time and date for the interview was arranged. Of the 21 potential participants who were identified as previously using GENIE™, 15 provided informed consent and took part in an interview. During the process of data collection, it became apparent that one participant did not meet inclusion criteria as they had no direct experience of using the GENIE™ intervention and as a result their data were not included in the analysis. Of the 10 national key stakeholders who were approached, 5 took part in the study. Reasons for non-participation included not being contactable, being on maternity leave, not meeting eligibility criteria, and not having enough time. 15 previous users of GENIE™ and 5 national key stakeholders consented to take part in the study. For more information relating to phase 1 study participants, see Table 1.
For the previous users of GENIE™, data saturation was thought to have occurred after 12 interviews and an additional 3 were undertaken to ensure further data collection did not meaningfully add to the results. For the national key stakeholders, each participant was expected to have unique specialist knowledge, therefore we were not expecting saturation in these interviews.
Data collection
One-to-one interviews were undertaken by ADF and LR (research associate and lived experience research assistant who were both female and had qualitative research experience) via telephone. No participants were known to data collectors prior to involvement in the study. Interview schedules were informed by the Consolidated Framework for Implementation Research (CFIR) [34] which emphasises the importance of evaluating complex interventions, including those with an element of online delivery, both within existing care contexts and broader social and organisational contexts [34]. CFIR provides a standardised list of constructs compiled from previous studies to support the identification of factors that are most salient to the implementation of a particular intervention [34]. This is a model which comprises a taxonomy of 39 operationally defined constructs across five domains that influence the implementation of complex interventions. The domains relate to the planned intervention, the contexts in which the implementation activities will occur (the ‘inner’ and ‘outer’ settings), the individuals involved, and the process of intervention delivery. This was designed to orient us to the nature of work required at multiple levels within a system for GENIE™ to be successfully implemented and its potential for scalability. Interview schedules were also reviewed by the patient and public advisory group to ensure their meaningfulness and relevance to the project aims overall. Please see Additional file 2: Appendix 2 for example interview questions.
Data analysis
Interviews were transcribed verbatim and anonymised before being analysed using Framework Analysis [35] which allowed for both inductive and deductive coding. Analysis of data drew on the constant comparative method [36].
Deductive coding was informed by the CFIR [34] and inductive analysis considered any data that fell outside this framework, ensuring that no important data was excluded. Analysis followed the seven stages of framework analysis [35]:
-
1: Transcription: Interviews were transcribed verbatim by an external transcription company.
-
2: Familiarisation with the data: Transcripts were first read and re-read by members of the research team in order for analysts to familiarise themselves with the data.
-
3. Coding: Each transcript was coded independently by two of eight members of the research team [35]. An analyst with lived experience of mental health difficulties undertook one set of coding for each of the transcripts.
-
4. Developing an analytical framework: Inductive codes were mapped to CFIR components with duplicates and redundant codes removed. No codes were identified that could not be incorporated within the CFIR framework. Codes were compared within and across cases, paying particular attention to negative cases and any reasons for identified discrepancies.
-
5. Applying the analytical framework: Transcripts were revisited as a whole to index the full set of transcripts to the CFIR domains.
-
6. Charting into the framework matrix: An excel spreadsheet was used to generate a matrix using CFIR domains and chart data into the matrix. This stage of the process involved summarising data relating to each CFIR domain for each transcript. Illustrative quotes were linked to summaries for purposes of illustration.
-
7. Interpreting the data: The final stage of the process involved comparing summaries between transcripts to develop interpretations of included data within each CFIR domain. This resulted in descriptive accounts of the potential implementation barriers and facilitators being developed for each of the five components. This process was undertaken collaboratively with analysts with lived experience of mental health difficulties and interpretations were checked with members of the research team with experience of providing services within secondary mental health care settings.
Trustworthiness of data analysis
We employed a number of strategies to ensure trustworthiness of data. These included checking 50% of transcripts against the original audio-files to ensure data accuracy prior to analysis, having two members of the research team independently code each transcript, having regular meetings between coders and the wider research team and keeping a documented audit trail of codes, frameworks and matrices. In line with the recommendations for framework analysis, we also required all coders to develop and document memos to support later interpretations and synthesis of data across transcripts.
We endeavoured to ensure that interpretations were grounded in the experience of providing and receiving care in secondary mental health services by ensuring that each transcript was independently coded by a researcher with lived experience of mental health difficulties. We also checked interpretative summaries with two additional members of the research team who had clinical experience of providing care within secondary mental health service settings.
Phase 2: adaption of the intervention for mental health services
We used a framework for experience-based co-design developed by King’s College London [37] to co-adapt the intervention and co-produce implementation strategies to support the future use of GENIE™ within secondary mental health services.
Participants
Participants were invited directly by Merseycare NHS Trust, and adverts were also placed on Merseycare’s social media. Participants were purposively sampled to ensure diversity in terms of age, gender and ethnicity:
-
49 service users expressed an interest in taking part in the study. 12 were invited to attend the focus group, of whom 8 attended (6 for the full event).
-
30 carers/supporters expressed an interest in taking part in the study. Given the attendance rates at the service user focus group, 15 were invited, of whom 9 attended. All participants attended for the full event.
-
12 professionals/volunteers expressed an interest in taking part in the study. All were invited to attend and 5 attended. An additional participant took part in a one-to-one consultation workshop, taking the total number of included professionals to 6. This workshop took place in January 2022, at the height of the Omicron wave in the UK, which is likely to have impacted recruitment.
For more detail on phase 2 participants, see Table 2:
Data collection
First consultation workshops
Information about the intervention and findings from phase 1 of ConNEct were presented to three stakeholder groups: 8 service users, 6 professionals/volunteers and 9 carers/supporters. Workshops were designed so that stakeholders could co-create recommendations for the adaptation and future use of GENIE™ within secondary mental health services and consider any potential barriers and facilitators to implementation.
Workshops lasted between 60 and 90 minutes, were held via Zoom, and were digitally recorded and transcribed verbatim.
Sustained smaller team co-design work
The research team worked closely with the patient and public advisory group to develop the implementation strategy from the priorities identified during the consultation workshops. No recommendations were made during the initial workshops for changes to GENIE™ itself as participants deemed this to be unnecessary.
Review event
The proposed implementation strategy was presented back to those who participated in the three consultation workshops in February 2022. Participants reviewed and provided feedback on the proposed evaluation protocol and implementation strategy. A revised manual for the proposed intervention is being drafted in collaboration with the patient and public advisory group and programme management group.
Analysis
Recommendations were extracted from each workshop transcript and mapped to a table in Word. Similar recommendations were combined with redundant ones removed. Multiple columns were added to the table in order to tabulate consensus between stakeholder groups and identify those recommendations that were endorsed by more than one group (Table 4). The synthesis table was checked by a second member of the team to ensure no data was lost during this process. The resultant table was used to inform the small co-design activities.
During the smaller team co-design activities, the research team in collaboration with the patient and public advisory group reviewed the table compiled from the initial workshops. This was undertaken through discussion which informed by the APPEASE criteria in order to reach consensus about the implementation recommendations to be taken forward [38]. The APPEASE criteria have been designed to support context-based decisions in relation to intervention content and delivery and comprise affordability, practicability, effectiveness and cost effectiveness, acceptability, side effects/safety and equity considerations [38]. Agreement was reached through discussion about which recommendations were considered to meet relevant APPEASE criteria and would therefore be taken for forward in the planning of subsequent studies.
Ethical considerations
This study received ethical approval from the Health Research Authority (Ref: 287584) and the North East - York Research Ethics Committee (Ref: 20/NE/0234).
The key ethical issues relating to this study relate to confidentiality, participant anonymity and informed consent to participate. We considered the risk to participants relating to distress during participation to be low given the study activities but designed a distress policy should this be necessary. There were no instances during the study whereby the distress policy needed to be implemented.
Robust data management procedures were implemented to minimise risks to study data being compromised. This included anonymisation of study data at the point of transcription and ensuring any quotes used in dissemination activities could not identify study participants. During phase 2 workshops, we agreed ground rules with attendees which included agreement that all information discussed should be treated as confidential and should not be discussed outside of the group.
Study documentation including information sheets and consent forms were written to current ethical standards and reviewed for clarity by our Patient and Public Advisory group. All participants who took part in the research process provided informed consent to participate in study activities.
Results
Phase 1
Systematic reviews
Review 1
Initial searches returned 22,367 manuscripts for review. Of these 841 were deemed suitable for full-text appraisal and 9 studies, randomising 2226 participants, were included in the review. Four focused on those with a diagnosis of schizophrenia or psychosis, one on major depressive disorder, and four on all mental health diagnoses.
The review determined that extant literature is of unclear quality and the evidence base relating to the use of social network interventions for people with mental health difficulties is in its infancy. However, the analysis provided preliminary evidence that network interventions which focus on connecting to and supporting social activities appear to hold the most promise. Whilst data on cost effectiveness and acceptability were limited, they highlight encouraging potential economic feasibility and acceptability for evaluating these interventions.
The review suggested that further research is required to understand the underlying mechanisms of action and to develop evidence-based recommendations for health services. Future research should i) incorporate nested process evaluations to understand and optimise implementation, ii) ensure meaningful patient and public involvement (PPI) to increase intervention uptake and acceptability, and iii) incorporate high-quality cost data to facilitate economic modelling.
Further detail on the results of this systematic review on the effectiveness of social network interventions for people with mental health problems is available here [20].
Review 2
Initial searches returned 22,367 manuscripts for review. Of these 841 were deemed suitable for full-text review and a total of 54 papers were included, consisting of 17 RCTs; 12 other quantitative studies; 14 qualitative studies and 11 mixed methods studies. Studies were included from the following countries: UK 25, USA 8, Australia 5, China 2, India 2, Ireland 2, Italy 2, Netherlands 2, Sweden 2, Canada 2, Denmark 1, Hungary 1. Analysis identified a range of micro, meso and macro level facilitators and barriers to implementing social network interventions for people with mental health difficulties which were sensitised using the CFIR. Exemplar factors are highlighted below:
-
Intervention: Accessibility, staff time, lack of training, length of intervention and sustainability, cultural alignment, financial support, links to existing organisations.
-
Outer setting: Socio-economic setting, community infrastructure, social hierarchy.
-
Inner setting: Place (safety, stigma, understanding of mental health).
-
Individual: Time, confidence, health, financial resources, readiness for participation, previous negative experiences, individual personal circumstances, literacy.
-
Process: Flexibility, allowing people to go at their own pace depending on circumstances, humour and engagement with valued activities, one-to-one work with facilitators to promote engagement, stigma reduction, structured support for real-world interaction.
Both reviews highlighted a lack of mental health focussed PPI in research in this area and identified a need for enhanced PPI to ensure the future acceptability and uptake of social network interventions.
Qualitative interviews
Key findings interpreted from the qualitative interviews are presented under each of the five CFIR components [34] and exemplar quotes can be found in Table 3.
Intervention characteristics - the attraction, appropriateness, and power of network mapping
Intervention characteristics relate to the key features of an intervention which affect its implementation. In general terms, this social network intervention was viewed positively by all study participants. They considered it to be flexible, adaptable to different populations, and clearly differentiated from other resources. The strength of the underlying evidence base and its ability to bring about cost savings for health services were considered to promote its credibility and contributed to the perception of relative advantage over other available interventions.
Out of the three elements (network-mapping, needs assessment and linkage to local resources), the network-mapping component was considered to be the most useful, particularly the visualisation of an individual’s social networks. Network-mapping was perceived to provide a welcome opportunity for reflection and a structured conversation about social connectedness. Participants described how this articulation empowered users to start to prioritise their own needs, a useful first step in the process of promoting community integration.
Whilst the potential to access an up-to-date list of local community resources was valuable, participants raised a range of implementation challenges which detracted from this value. For example, the filtering capability of relevant resources was considered limited. The relevance and usefulness of suggested local support was dependent on resources being appropriately mapped, tagged and updated, which required significant investment of time and resources. This was particularly challenging given the fragile nature of funding for third sector organisations, with the results that the database infrastructure would likely become outdated relatively quickly. This could be off-putting for organisations when they were considering the possibility of mainstreaming GENIE™.
This issue of trustworthiness and confidence in this data was exacerbated by a range of technological problems and interface challenges when GENIE™ tried to access the database. Participants also identified a need for further filters and more advanced searching options. They raised safeguarding concerns about the lack of vetting of organisations, which could have future legal ramifications. Some previous users of GENIE™ felt that this issue could also lead to inactivity amongst those who use it, rendering any benefits unsustainable once contact with the intervention ceased.
As a result of these challenges with the final stage of the intervention, participants considered the third, resource linking aspect to be weak. The first (network-mapping) and second (needs assessment) elements of GENIE™ were considered to be the most usable and valuable in terms of bringing about therapeutic value for users.
Fit with approaches and characteristics of the outer setting
The ‘outer setting’ which comprises the characteristics of the external context in which an intervention is delivered impacting on implementation. GENIE™ was considered by participants to be closely aligned to the personalised care agenda and this, along with its solution-focused approach, was perceived to contribute to its value and suitability for implementation in mental health services.
Participants coalesced in their views that the intervention had clear relevance to the needs of mental health service users. However, they identified a range of barriers that might influence individual uptake of the intervention and prevent engagement with community activities. Poor provision of local infrastructure and the poverty of local environments created barriers for people. These barriers included a lack of transport, competing priorities, digital poverty, limited financial resources, childcare or caring responsibilities, and reduced capacity as a result of mental health symptoms.
Participants who had experience of facilitating GENIE™ also described challenges in engaging with people from diverse communities. Those more likely to be excluded were people with severe physical illness or disability, those who were very socially isolated and those from minority ethnic groups. As a result, participants felt that acceptable delivery of GENIE™ required a good understanding of the characteristics and needs of the target population, in order to ensure equity of access and benefit. Participants felt that organisations which were embedded in local communities and had high levels of social capital were best placed to deliver this type of social network intervention.
Financial pressures, extant cultures and limited resources within the statutory and voluntary sector were also identified as potential barriers to successful implementation. Participants felt that the impact of this could be mitigated by ensuring that the use of these types of interventions is closely aligned to existing systems, in order to minimise burden to organisations (e.g., by using GENIE™ as part of care planning approach or discharge planning).
Inner setting fit with existing organisation culture and work practices
The inner setting refers to the features of the internal context in which an intervention is delivered impacting on implementation. Participants highlighted the importance of GENIE™’s alignment to the culture and ethos of the implementing organisation as well as the intervention’s fit with existing systems. It was also considered important that the organisation workforce had the requisite skills and capacity to deliver the intervention and to maximise potential reach. There could be a tension between the willingness or desire to implement such an intervention and the capacity to deliver and reach potential beneficiaries.
Buy-in at all levels of an organisation, including managerial buy-in, was considered to be fundamental to successful implementation of GENIE™. Managerial buy-in increased the likelihood that protected time would be given to training for and delivery of the intervention, and that the intervention could be fully integrated into existing roles and systems. This process could also be supported by having champions within an organisation who could drive forward implementation.
Readiness to implement GENIE™ also requires IT support to facilitate intervention delivery, to ensure that the database is up-to-date, and to deal with any technical hitches. Facilitators should be given dongles to ensure internet access when delivering the intervention off-site and they should take paper copies of intervention materials as a back-up.
Characteristics of individuals: facilitators sensitivity to personal and social circumstances and the importance of rapport
Successful implementation of any intervention is heavily reliant on those delivering or facilitating it. Facilitation was identified as the key mechanism through which benefits of the intervention could be realised. This could be a complicated and delicate process which required significant skill, relational expertise, and confidence on the part of facilitators. It could be especially challenging when those accessing GENIE™ had limited support from social networks.
In light of this importance of skilled facilitation, participants emphasised key attributes and skills required in facilitators. These included sufficient time and resources to deliver GENIE™, a relevant professional background; appropriate personal values; adequate knowledge of the local area; an understanding of the value of the social aspects of health; empathy and rapport-building skills; and the ability to take a person-centred approach. These valued characteristics were felt by some participants to be especially prevalent in peer facilitators.
Participants also highlighted the importance of mental health specific training to support the delivery of GENIE™ in this context (see below).
Process of implementation – the need for buy-in, flexibility and adequate planning
Participants identified a range of potential impediments to the successful implementation of GENIE™. Dedicating sufficient time and resources to planning implementation was considered to be important. Set-up meetings were felt to be particularly effective for this, especially when attended by as many people within and around the organisation as possible. This was considered to promote transparency and to promote optimal allocation of the practical tasks associated with implementing the intervention.
Participants agreed that GENIE™ was better implemented and delivered face-to-face rather than remotely. This appeared to be due to the significant engagement work required which was considered best done in-person and the emphasis on the visual aspects of GENIE™. Reluctance to deliver GENIE™ remotely was heightened by online experiences during the recent covid-19 pandemic including zoom fatigue and challenges engaging with people remotely.
Flexibility in terms of supporting local and individual adaptations to the delivery of GENIE™ was considered to promote successful implementation. Participants believed that social connectedness interventions work best when personalised and tailored to the individual. This was felt to be particularly the case if potentially using GENIE™ with those with mental health difficulties, where flexibility in the timing of delivery was key. For example, some people would benefit most using GENIE™ on referral to a mental health service, while others would find it more helpful at discharge. Decisions needed to be made on a case-by-case basis and based on the needs and preferences of the individual. However, participants agreed that the intervention should not be used during acute periods of illness or as a way to hasten discharge from services.
Participants emphasised the importance of adequate and ongoing training to support the delivery. This was seen as needing to include mental health specific GENIE™ training if using the intervention within a mental health context, and organisations should provide opportunities for facilitators to access reflective peer learning. Training was seen to need a focus on practical and engagement activities and how to take a personalised approach to delivery, with less attention given to the research or academic background of developing the intervention.
As part of the ongoing process of implementation, the benefits - both in terms of therapeutic benefit for the individual and organisational benefits such as cost savings - should be demonstrable both to facilitators and to members of the wider organisation. This was seen to promote ongoing buy-in and engagement.
Phase 2
The consultation workshops demonstrated unanimous support across all stakeholder groups for the use of a social network intervention which had as its focus the facilitation of social integration and access to activities and connections to others in mental health services. Stakeholders did suggest a range of strategies and considerations for implementation. Participants felt that whilst in principle the ideas of community resource-mapping were of value in principle, in practice it would be challenging to implement and maintain and added complexity and burden to what was seen to work best which was the network mapping and eliciting preferences. Participants felt a broader national and online support, including advocacy groups and service user/carer forums would be of most use.
Participants coalesced in their views of where social network interventions might work best within secondary mental health services. These include:
-
Care planning meetings,
-
Discharge from hospitals,
-
Early intervention services.
Participants also made detailed suggestions for ensuring acceptability to mental health service users. These included making participation in the intervention optional and accessible, providing opportunities for service users to invite a carer, friend or family member to take part in the facilitation of the intervention alongside them, and undertaking personalised approaches to facilitation with explicit acknowledgement that one approach is unlikely to work for everyone.
A full list of identified priorities for the future use of GENIE™, organised by stakeholder group, can be found in Table 4.
Discussion
The ConNEct study was designed to co-adapt, with service users, carers/supporters, clinicians and volunteers, an existing, evidence-based social network intervention for use in secondary mental health services. This is needed because research has shown that whilst people with severe and/or enduring mental health difficulties can confer benefit from diverse and supportive social networks, they are also found to have smaller social networks and networks of poorer quality and social connectiveness and activities are a needed component for recovery [9,10,11].
Service users consistently value holistic care, particularly discussions and interventions related to their social networks, but many feel these approaches are under-utilised and their importance underacknowledged in secondary mental health services [39]. This may reflect the current organisation of health services which is focussed on diagnosis, severity and deficits rather than locality and need.
Many health professionals remain disconnected from every day and community settings and their potential therapeutic value [39]. Developing effective ways to support professionals to deliver this personalised, recovery-oriented model of health and social care, which considers an individual within their social environment as a public health concern requires greater investment and focus.
Participants across both stages of the co-adaptation process highlighted a range of problems associated with the final resource-mapping stage of the GENIE™ intervention. Logistical challenges associated with the hosting and maintenance of an up-to-date database which incorporates sufficient breadth of resources to suit the range of potential users has been highlighted previously [26]. As a result, participants across both phases questioned the need for this final aspect, especially given the perceived therapeutic value of the first two stages (visualisation and needs assessment) when used on their own. These concerns were echoed by members of the patient and public advisory group.
One potential solution is to remove this final element and supplement stages 1 (social network visualisation) and 2 (needs assessment) with a focussed and personalised discussion planning how to improve social connectedness and engagement with valued activities. Persisting with a cumbersome and untrustworthy element compounded by technological failure is likely to undermine the elements which work well on their own merit. The individualised nature of this final planning stage was considered to be essential for mental health service users, who face multiple and diverse barriers to community engagement. This recommendation is supported by previous research which has demonstrated that a facilitated social network mapping exercise, focused on the broader social environment and sense of place as the key mechanism of engagement, can facilitate meaningful conversations about future social connectedness [24, 40]. This has been shown to translate to measurable benefits for service users and their families. Our systematic review demonstrated that provision of a financial stipend, in place of this local resource-mapping, may confer similar levels of benefit for participants [20]. This financial stipend was also considered to mitigate barriers to community engagement (e.g., access to transport, childcare, and activities with a cost attached).
Supporting flexibility in the delivery of a social network intervention was highlighted as fundamental to successful implementation both by those who had previously adopted the intervention and in our systematic reviews. Social network interventions were considered to work best when they were oriented to local context and personalised. This was echoed in the consultation workshops and ongoing co-adaptation work. Suggestions included making the use of GENIE™ or similar social network tools optional and widely available and accessible at any point, offering users the opportunity to invite a carer, friend or family member to participate in intervention delivery sessions; and ensuring flexibility in the timing of delivery. Using personal network mapping in mental health services is not new and the principles can be simply undertaken in drawing a map and does not need to be part of formal trademarked intervention for example.
The challenges faced when implementing a complex intervention into open systems can never be predicted in their entirety and successful implementation requires a degree of responsive flexibility [41]. Preparatory work for definitive evaluation as undertaken in the current study, underpinned by theories of implementation research, can mitigate potential impediments to implementation [34]. The co-creation of a systematic implementation strategy facilitates a consistent approach to evaluation which protects fidelity whilst adequately incorporating requisite levels of flexibility. Future evaluations should follow MRC guidelines for the evaluation of complex interventions and incorporate both randomised controlled trials and nested mixed methods process evaluations [29]. This would facilitate an examination of the underlying mechanisms of impact; enable the potential for intervention adaptation to be realised; and support the identification of minimum conditions required for patient and organisational benefit.
Participants in our study identified a range of skills and characteristics required for therapeutic facilitation of GENIE™. These were seen to be more important than any clinical or professional background. Individual attributes that were seen to be necessary included an empathetic approach, an understanding of the social aspects of health, relational skills, and knowledge of local communities. Furthermore, participants raised the importance of aligning facilitation with existing systems and processes within organisations, not least to mitigate against perceptions that delivering the intervention would increase workloads and be unmanageable for staff. This is particularly important given the financial and resource-related pressures that mental health services are currently facing [42]. Participants also reported the value of peer facilitation, which has also been highlighted in the previous implementation of interventions for both physical and mental health conditions [43,44,45]. However, evidence to support this approach for social network interventions for people with mental health difficulties was minimal within our systematic reviews and further research is required to understand the potential of peer facilitation in this context [20]. Particular attention should be given to development of job descriptions and personal specifications for facilitators and associated training and development plans. Participants also advocated for the development of mental health specific training for those facilitating these types of interventions in a mental health context, given the differences in the experience of mental and physical health conditions and additional barriers to engagement that mental health symptoms can create.
Our systematic reviews demonstrated the potential effectiveness of social network interventions for people with mental health difficulties but identified a lack of patient and public involvement in the extant evaluations of social network interventions across the world [20]. Future evaluations of these types of interventions should ensure adequate levels of PPI and draw on recent toolkits designed to promote meaningful and flexible involvement in clinical trials [46]. The full evaluation of GENIE™ in secondary mental health services will build upon and develop the PPI that has been so important to the project thus far. The work of the advisory group has already transcended an advisory role: we plan to formalise this by upgrading it to an involvement group whose remit explicitly encompasses active participation in all elements of the project, including design and oversight of the trial. The involvement group will coproduce materials and a support package for participants, and they will work with the research team to develop an agreed core outcome set and to gather, analyse and write up the resulting data. We aim to expand the group to 12 members and to introduce a targeted recruitment strategy to improve diversity, using the 9 protected characteristics of the Equality Act 2010 to ensure representation of a wider range of marginalised groups. This will ensure that the evaluative design is relevant and appropriate; that included measures reflect patient-prioritised outcomes; that trial processes are fit for purpose; that trial participants are meaningfully supported; and that acceptability to service users is prioritised, supporting recruitment and retention of trial participants and promoting successful implementation of the intervention in future.
Our study draws its strength from a combination of in-depth and collaborative research approaches and from the use of a recent implementation science framework to underpin study design. PPI was a particular strength: contributors brought their lived experience of mental health difficulties as co-researchers to the design of data collection tools, such as interview schedules and consultation workshops, and to data interpretation and analysis. This has enhanced the depth and nuance of our findings and will help to ensure that GENIE™ is developed and implemented to be truly beneficial to mental health service users. Data were collected in one site in the UK as this is expected to be where the intervention will be implemented and evaluated in the next stage of the programme of research. As such, an in-depth understanding of this implementation context will support the clinical trial and evaluation. Further research to implement such interventions should consider similar preparation and planning in order to fully understand local contextual factors that could impact intervention uptake and use in order to support equality, diversity and inclusion in future use and evaluation of such interventions [47, 48].
Conclusion
We have identified a pressing need to implement social network interventions within mental health services. Our systematic reviews highlight the potential effectiveness of these types of interventions but identify a lack of rigorous and user-centred evaluations. Patient and public involvement is also lacking across this field of study, and its importance in every phase of both research and implementation has been another of our key findings. Our study has derived significant value from PPI across all study elements.
The systematic reviews and empirical work identified a range of factors that must be considered for successful implementation of interventions such as GENIE™. We have synthesised this information and co-produced an evidence-based implementation strategy and evaluation protocol. The next planned phase of the co-produced programme of work is to design and implement a randomised controlled trial to evaluate its clinical and cost effectiveness within secondary mental health services.
Availability of data and materials
The datasets generated and/or analysed during the current study are not publicly available due to ethical restrictions but are available from the corresponding author on reasonable request.
Abbreviations
- CFIR:
-
Consolidated Framework for Implementation Research
- GENIE™:
-
Generating Engagement in Networks Involvement intervention
- NHS:
-
National Health Service
- MMAT:
-
Mixed methods appraisal tool
- PPI:
-
Patient and Public Involvement
- RCT:
-
Randomised controlled trial
- UK:
-
United Kingdom
- USA:
-
United States of America
References
Baker C. Mental health statistics (England). London: House of Commons Library; 2021.
Department of Health and Social Care. No health without mental health: a cross-government outcomes strategy. London: Department of Health and Social Care; 2011.
Mental Health Taskforce. The five year forward view for mental health. London: Mental Health Task Force; 2016.
NHS. The NHS long term plan. London: NHS; 2019.
NHS England and NHS. Improvement and the National Collaborating Central for mental health. The community mental health framework for adults and older adults. London: NHS England; 2019.
NIHR Dissemination Centre. Forward thinking. NIHR research on support for people with severe mental illness. London: National Institute of Health Research; 2018.
Salehi A, Ehrlich C, Kendall E, Sav A. Bonding and bridging social capital in the recovery of severe mental illness: a synthesis of qualitative research. J Ment Health. 2019;28(3):331–9.
Piat M, Seida K, Sabetti J. Understanding everyday life and mental health recovery through CHIME. Ment Health Soc Incl. 2017;21(5):271–9.
Anderson K, Laxhman N, Priebe S. Can mental health interventions change social networks? A systematic review. BMC Psychiatry. 2015;15. https://doi.org/10.1186/s12888-015-0684-6.
Sweet D, Byng R, Webber M, Enki DG, Porter I, Larsen J, et al. Personal well-being networks, social capital and severe mental illness: exploratory study. Br J Psychiatry. 2018;212(5):308–17.
Walker S, Kennedy A, Vassilev I, Rogers A. How do people with long-term mental health problems negotiate relationships with network members at times of crisis? Health Expect. 2018;21(1):336–46.
Brooks HL, Bee P, Lovell K, Rogers A. Negotiating support from relationships and resources: a longitudinal study examining the role of personal support networks in the management of severe and enduring mental health problems. BMC Psychiatry. 2020;20(1):50.
Latkin CA, Knowlton AR. Social network assessments and interventions for health behavior change: a critical review. Behav Med. 2015;41(3):90–7.
Priebe S, Omer S, Giacco D, Slade M. Resource-oriented therapeutic models in psychiatry: conceptual review. Br J Psychiatry. 2014;204:256–61.
Band R, James E, Culliford D, Dimitrov B, Kennedy A, Rogers A, et al. Development of a measure of collective efficacy within personal networks: a complement to self-efficacy in self-management support? Patient Educ Couns. 2019;102(7):1389–96.
Vassilev I, Band R, Kennedy A, James E, Rogers A. The role of collective efficacy in long-term condition management: a metasynthesis. Health Soc Care Community. 2019;27(5):e588–603.
Reeves D, Blickem C, Vassilev I, Brooks H, Kennedy A, Richardson G, et al. The contribution of social networks to the health and self-management of patients with long-term conditions: a longitudinal study. Plos One. 2014;9(6).
Hunter RF, de la Haye K, Murray JM, Badham J, Valente TW, Clarke M, et al. Social network interventions for health behaviours and outcomes: a systematic review and meta-analysis. Plos Med. 2019;16(9):e1002890.
Blakeman T, Blickem C, Kennedy A, Reeves D, Bower P, Gaffney H, et al. Effect of information and telephone-guided access to community support for people with chronic kidney disease: randomised controlled trial. Plos One. 2014;9(10).
Brooks H, Devereux-Fitzgerald A, Richmond L, Bee P, Lovell K, Caton N, et al. Assessing the effectiveness of social network interventions for adults with a diagnosis of mental health problems: a systematic review and narrative synthesis of impact. Soc Psychiatry Psychiatr Epidemiol. 2022:907–25.
Coffey M, Hannigan B, Meudell A, Jones M, Hunt J, Fitzsimmons D. Quality of life, recovery and decision-making: a mixed methods study of mental health recovery in social care. Soc Psychiatry Psychiatr Epidemiol. 2019;54(6):715–23.
Morgan S. ‘Strengths’ assertive outreach: a review of seven practice development programmes. Ment Health Rev J. 2008;13(2):40–6.
Leamy M, Bird V, Le Boutillier C, Williams J, Slade M. Conceptual framework for personal recovery in mental health: systematic review and narrative synthesis. Br J Psychiatry. 2011;199(6):445–52.
Kennedy A, Vassilev I, James E, Rogers A. Implementing a social network intervention designed to enhance and diversify support for people with long-term conditions. A qualitative study. Implement Sci. 2016;11(1):27.
Welch L, Orlando R, Lin SX, Vassilev I, Rogers A. Findings from a pilot randomised trial of a social network self-management intervention in COPD. BMC Pulm Med. 2020;20(1):162.
Valaitis R, Cleghorn L, Vassilev I, Rogers A, Ploeg J, Kothari A, et al. A web-based social network tool (GENIE™) for supporting self-management among high users of the health care system: feasibility and usability study. JMIR Form Res. 2021;5(7):e25285.
Brooks HL, Rogers A, Sanders C, Pilgrim D. Perceptions of recovery and prognosis from long-term conditions: the relevance of hope and imagined futures. Chronic Illness. 2014.
Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.
Skivington K, Matthews L, Simpson SA, Craig P, Baird J, Blazeby JM, et al. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. 2021;374:n2061.
Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. Br Med J. 2019;366:l4898.
Hong QN, Gonzalez-Reyes A, Pluye P. Improving the usefulness of a tool for appraising the quality of qualitative, quantitative and mixed methods studies, the mixed methods appraisal tool (MMAT). J Eval Clin Pract. 2018;24(3):459–67.
Brooks H, Sanders C, Lovell K, Fraser C, Rogers A. Re-inventing care planning in mental health: stakeholder accounts of the imagined implementation of a user/carer involved intervention. BMC Health Serv Res. 2015;15(1):490.
Biernacki P, Waldorf D. Snowball sampling: problems and techniques of chain referral sampling. Sociol Methods Res. 1982;10(2):141–63.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.
Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13(1):117.
Glaser BG. The constant comparative method of qualitative analysis. Soc Probl. 1965;12(4):436–45.
Donetto S, Pierri P, Tsianakas V, Robert G. Experience-based co-design and healthcare improvement: realizing participatory design in the public sector. Des J. 2015;18(2):227–48.
Michie S, Atkins L, R. W. The APEASE criteria for designing and evaluating interventions. In: Michie S, Atkins L, R W, editors. The behaviour change wheel: a guide to designing interventions. London: Silverback Publishing; 2014.
Brooks HL, Lovell K, Bee P, Sanders C, Rogers A. Is it time to abandon care planning in mental health services? A qualitative study exploring the views of professionals, service users and carers. Health Expect. 2018;21(3):597–605.
James E, Kennedy A, Vassilev I, Ellis J, Rogers A. Mediating engagement in a social network intervention for people living with a long-term condition: a qualitative study of the role of facilitation. Health Expect. 2020;23(3):681–90.
Simpson KM, Porter K, McConnell ES, Colón-Emeric C, Daily KA, Stalzer A, et al. Tool for evaluating research implementation challenges: a sense-making protocol for addressing implementation challenges in complex research settings. Implement Sci. 2013;8(1):2.
Buchan J, Gershlick B, Charlesworth A, Seccombe I. Falling short: the NHS workforce challenge. London: The Health Foundation; 2019.
Gillard S. Peer support in mental health services: where is the research taking us, and do we want to go there? J Ment Health. 2019;28(4):341–4.
Gillard S, Foster R, Turner K. Evaluating the prosper peer-led peer support network: a participatory, coproduced evaluation. Mental Health Soc Inclusion. 2016;20(2):80–91.
Crozier A, Porcellato L, Buckley BJR, Watson PM. Facilitators and challenges in delivering a peer-support physical activity intervention for older adults: a qualitative study with multiple stakeholders. BMC Public Health. 2020;20(1):1904.
Bagley HJ, Short H, Harman NL, Hickey HR, Gamble CL, Woolfall K, et al. A patient and public involvement (PPI) toolkit for meaningful and flexible involvement in clinical trials – a work in progress. Res Involve Engage. 2016;2(1):15.
May CR, Johnson M, Finch T. Implementation, context and complexity. Implement Sci. 2016;11(1):141.
Pfadenhauer LM, Gerhardus A, Mozygemba K, Lysdahl KB, Booth A, Hofmann B, et al. Making sense of complexity in context and implementation: the context and implementation of complex interventions (CICI) framework. Implement Sci. 2017;12(1):21.
Acknowledgements
The authors would like to thank the participants in each study phase for their contributions to the study and the patient and public advisory group for their ongoing support of the project.
Funding
This project is funded by the National Institute for Health Research (NIHR) under its Research for Patient Benefit (RfPB) Programme (Grant Reference Number PB-PG-0418-20011). The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.
Author information
Authors and Affiliations
Contributions
HB, MGC, KL, PB, II, BY, AR, CR were responsible for obtaining funding for the study and designing the research project. ADF and LR conducted phase 1 interviews and HB and LR facilitated phase 2 workshops. HB, NC, JD, MGC, KL, PB, BY, ANB, LR, ADF were involved in data analysis. HB led the drafting of manuscript. All authors read, commented on manuscript drafts and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study received ethical approval from the Health Research Authority (Ref: 287584) and the North East - York Research Ethics Committee (Ref: 20/NE/0234). All participants who took part in the research process provided informed consent to participate in study activities. All methods were performed in accordance with this ethical approval and all relevant guidelines and regulations.
Consent for publication
Research participants provided consent for the publication of quotes and data analysis during the informed consent process.
Competing interests
HB is an associate editor for BMC Health Services Research.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1:
Appendix 1. Additional information on the GENIE™ intervention (taken from James E, Kennedy A, Vassilev I, Ellis J, Rogers A. Mediating engagement in a social network intervention for people living with a long-term condition: A qualitative study of the role of facilitation. Health Expect. 2020;23(3):681-690. doi:10.1111/hex.13048).
Additional file 2:
Appendix 2. Example interview questions.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Brooks, H., Devereux-Fitzgerald, A., Richmond, L. et al. Adapting a social network intervention for use in secondary mental health services using a collaborative approach with service users, carers/supporters and health professionals in the United Kingdom. BMC Health Serv Res 22, 1140 (2022). https://doi.org/10.1186/s12913-022-08521-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12913-022-08521-1