Abstract
Background
Providing comprehensive and continuous care for patients whose conditions have mental or behavioral components is a central challenge in primary care and an important part of improving universal health coverage. There is a great need for high and routine availability of psychological interventions, but traditional methods for delivering psychotherapy often result in low reach and long wait times. Primary Care Behavioral Health (PCBH) is a method for organizing primary care in which behavioral health staff provide brief, flexible interventions to a large part of the population in active collaboration with other providers. While PCBH holds promise in addressing important challenges, it has not yet been thoroughly evaluated.
Methods
This cluster randomized trial will assess 17 primary care centers (PCCs) that are starting a PCBH implementation process. The PCCs will be divided into two groups, with one starting immediate implementation and the other acting as a control, implementing six months later. The purpose of the study is to strengthen the evidence base for PCBH regarding implementation-, organization-, and patient-level outcomes, taking into consideration that there is a partially dependent relationship between the three levels. Patient outcomes (such as increased daily functioning and reduction of symptoms) may be dependent on organizational changes (such as availability of treatment, waiting times and interprofessional teamwork), which in turn requires change in implementation outcomes (most notably, model fidelity). In addition to the main analysis, five secondary analyses will compare groups based on different combinations of randomization and time periods, specifically before and after each center achieves sufficient PCBH fidelity.
Discussion
A randomized comparison of PCBH and traditional primary care has, to our knowledge, not been made before. While the naturalistic setting and the intricacies of implementation pose certain challenges, we have designed this study in an effort to evaluate the causal effects of PCBH despite these complex aspects. The results of this project will be helpful in guiding decisions on how to organize the delivery of behavioral interventions and psychological treatment within the context of primary care in Sweden and elsewhere.
Trial registration
ClinicalTrials.gov: NCT05335382. Retrospectively registered on March 13th, 2022.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
Primary care constitutes a foundation for the healthcare system by providing a first line of somatic and mental care, as well as continuous, long-term management of chronic and complex health problems [1]. Almost half (46%) of all adults experience mental illness over the course of their lifetime, and the majority of these patients are treated in primary care, where up to a third of all visits are related to mental health [2,3,4]. Mental health conditions substantially reduce functioning [5] and quality of life [6], as well as contributing significantly to sickness absence, productivity loss and unemployment [7, 8]. In addition, there is a strong relationship between mental health and chronic somatic diseases, such as diabetes, obesity, and persistent pain, and many patients have complex health problems with multiple somatic and mental comorbidities as well as social difficulties [9,10,11]. In addition to the suffering experienced by the individual, these conditions pose an enormous economic burden [12]. It therefore follows that the quality of primary care has direct implications for many patients’ health and daily lives, as well as society at large. As such, the World Health Organization (WHO) has designated the integration of mental health services into primary care a key objective, highlighting its role in achieving universal health coverage [13, 14]. However, the volume and complexity of mental health concerns presenting in primary care currently exceeds its capacity and competence [13, 15, 16]. In Sweden, most primary care centers (PCCs) have introduced on-site clinical psychologists or social workers, and national policies state that early access to psychological treatments is to be prioritized over pharmacological interventions in most cases of mild to moderate mental health problems [17, 18]. However, in many PCCs psychological care is still hard to access, likely because the traditional model for delivering psychotherapy and psychosocial interventions is impossible to scale up enough to meet the need for such treatment [19]. Consequently, Swedish primary care patients rarely receive nonpharmacological interventions for their mental and behavioral health, with only 3% of patients meeting with a psychologist or social worker [20]. On a global scale, the service gap is even more pronounced, with a large proportion of people with mental health conditions receiving no formal care at all [21].
Primary Care Behavioral Health (PCBH) is a team-based model aiming to enhance primary care by integrating behavioral health expertise, with the goal of improving care for the entire clinic population [22]. Interventions within the model focus on behaviors and skills relevant for preventing deleterious somatic and psychological health outcomes and can take many forms, for example as selected interventions from evidence-based cognitive behavioral therapy (CBT) manuals or as interventions specifically designed to be brief, such as Focused Acceptance and Commitment Therapy (FACT) [16, 23,24,25,26]. PCBH is characterized by routine delivery of such interventions to a large proportion of patients, with high availability and productivity. It utilizes teamwork and task-sharing between and across professional disciplines to increase flexibility, efficiency, and treatment adherence as well as share knowledge and build consensus among staff. A central part of the model is freeing up resources by providing brief visits, usually no more than 30 min in length, one visit at a time rather than in a planned series of visits. Follow-up is based on a ‘consultant’ rather than a ‘therapist’ approach, where the patient is not followed until the point of remission but until there is some improvement in symptoms or functioning. Treatments are open-ended, meaning that patients can easily book another visit if they need to. For large or resource-intensive patient categories, clinical pathways incorporating group sessions or online interventions are frequently employed. A pragmatic and population-based mindset, where the available resources are used to reach as many patients as possible, permeates the model.
PCBH has gained popularity, likely due to its promise of a much-needed increase in the availability of psychological interventions. Previous research indicates that brief psychotherapeutic interventions within integrated care lead to broad improvements in symptom reduction, functioning and well-being across a multitude of problem areas [23, 25, 27,28,29,30,31,32,33,34,35,36,37,38,39,40,41]. Studies have also indicated that PCBH is cost-effective [41,42,43,44,45,46,47], appreciated by care providers [45, 48,49,50,51] as well as patients [48, 50, 52], and that the model can improve access to and reduce wait time for mental health services [53, 54]. However, as of yet, there are no large-scale comparative studies of high quality [55, 56]. Achieving and studying change in primary care can be difficult, especially when implementing complex interventions that require change across multiple levels [57]. This is especially true for PCBH, as most mental health staff lack training in how to effectively adapt to the primary care setting, which complicates implementation and highlights the role of model fidelity in the evaluation of the model [58,59,60].
Methods/design
The main purpose of the current project is to strengthen the evidence base for PCBH regarding implementation-, organization-, and patient-level outcomes by conducting the first large-scale randomized study on the model, taking a step toward answering whether the effects of the model are large enough to merit scaling up implementation. The research questions of primary interest are divided into three levels, where outcomes of higher levels are more or less dependent on the lower levels (i.e., patient outcomes may be dependent on organizational outcomes and both are clearly dependent on implementation outcomes; see Fig. 1):
-
Implementation level:
-
What is the timeline for partial implementation (FID2) as well as achieving adequate model fidelity (FID3, primary implementation level outcome) in PCCs adopting the PCBH model?
-
How do healthcare staff perceive the acceptability, feasibility, and appropriateness of PCBH, and to what extent do they adhere to the model?
-
What are the observed obstacles and facilitators during implementation?
-
-
Organizational level:
-
Is PCBH superior to traditional Swedish primary care in reducing waiting times (primary organization level outcome) and increasing patient reach?
-
Does PCBH result in shorter treatment lengths and lower costs for staff and resources compared to traditional primary care?
-
Does PCBH improve interprofessional collaboration and staff work environment compared to traditional care?
-
Does PCBH impact medication prescription patterns, sick leave utilization, and patients’ care consumption, thereby influencing related costs?
-
-
Patient level:
-
Is PCBH superior to traditional Swedish primary care in terms of patient outcomes, including everyday functioning (primary patient level outcome), symptoms, quality of life, satisfaction with care, subjective change, and adverse events?
-
If not superior, is PCBH non-inferior to traditional primary care?
-
What methods are used within brief interventions and what strategies do patients adopt after treatment?
-
The primary comparisons between PCBH and traditional primary care will consider model fidelity at both the organizational and patient levels. The main analysis will compare PCCs randomized to the early implementation arm once they reach satisfactory fidelity with PCCs in the control group.
Design and overall procedure
The project is a cluster-randomized clinical trial following Good Clinical Practice (GCP) principles. Standard Operating Procedures will be developed for key routines, and digital Client Report Files will be stored in the study technical platform provided by Karolinska Core Facilities. Study coordinators will primarily monitor data quality and routines internally. This protocol was devised according to the SPIRIT reporting guidelines [61]. Any substantial amendments to this protocol will be tracked, dated and described in trial reports.
Data will be collected at Närhälsan, the provider of public primary care in Västra Götaland, Sweden, consisting of 104 PCCs in both urban and rural areas. This project studies a naturalistic implementation effort initiated by Närhälsan, with external trainers and supervisors procured by the organization. The study will utilize a cluster-randomized design, randomly assigning PCCs to either implement PCBH immediately (EARLY) during the first 5–9-month period or act as control centers and implement PCBH during the second period (DELAYED). Period 1 starts when all PCCs in the EARLY group have scheduled starting dates during on-site consultations. Period 2 begins when all PCCs in the DELAYED group have done the same, within 5 to 9 months after the start of Period 1. Provided sufficient project resources, period 2 can be lengthened to allow for continued data collection. Patient measures will be collected up to two months before Period 1, and some organizational measures up to one year in advance, establishing a baseline for each PCC. As the project, due to the naturalistic approach, has little direct control over how well a PCC implements PCBH, the analysis plan covers several scenarios where varying degrees of model fidelity are considered (see Data analysis plan).
Participating primary care centers and randomization
The project includes 8 subregions within Närhälsan, each providing 1–4 PCCs that do not currently adhere to PCBH principles but are willing to implement the model and be part of the randomization process. No other inclusion or exclusion criteria were applied. Basic characteristics of PCCs will be collected through semi-structured interviews at the beginning of the study. This includes information such as the number of listed patients, sociodemographic indexes, number of mental health staff and their training, whether there is and the size of any queues for mental health treatment, as well as details about triage, referrals, and teamwork routines.
In total, 17 PCCs serving a total of 187 000 patients have chosen to participate. For a list of sites, see ClinicalTrials.gov registration. Cluster randomization between the EARLY and DELAYED arms will be conducted using the online tool randomization.com in a 1:1 ratio. The Karolinska Trial Alliance (KTA), an independent unit, performs the randomization separately for each subregion without block division to ensure at least one PCC in the EARLY arm per subregion. If the distribution of PCCs between study arms deviates by more than one, KTA will repeat the randomization until the distribution is balanced or deviates by one. Only the results will be shared with the researchers. Any additional PCCs joining the project after subregion randomization but before the start of implementation period 1 will be randomized by KTA using list randomization with even blocks of random sizes determined by KTA and not shared with researchers.
Participant recruitment and power analysis
All patients aged 18 and above who are suitable for behavioral or mental health interventions, regardless of diagnoses and concomitant care, will be invited to participate in the study. This inclusive approach aligns with the naturalistic setting and the broad scope of the PCBH model. Trained research assistants will identify and contact potential participants, providing digital access to written information and a consent form. Participants will be kept blind to the implementation status of PCBH in their respective PCCs, as all are only informed that the study aims to evaluate and improve mental health treatment in primary care.
We estimate that 70% of patients identified and informed about the study will consent to participate. Power calculations aiming for a power of 90% in detecting a difference of d = 0.4 on a superiority test on the primary patient outcome, adjusted for the lower power in a cluster randomized design with 8 PCCs in one group and 9 in the other, estimating the Intracluster Correlation Coefficient (ICC) to 0.01 [62] and a follow-up response rate of 80%, indicate that a total of 476 patients need to be analyzed, 595 patients recruited, and 850 identified and informed.
If PCBH’s superiority over traditional care is not established, a secondary aim is to determine if PCBH is non-inferior. Since there is currently no empirically based definition of the minimal clinically important difference for WHODAS-12 [63] and even less so for the 8-item version we use (see below), we will adopt a conservative non-inferiority margin based on recommendations for a minimally relevant clinical effect for depression, with a Cohen’s d of 0.24 [64]. To achieve 80% power with the same ICC as mentioned earlier, this analysis would require the inclusion of 815 patients, with a total of 1455 patients identified and informed. However, this is a secondary objective dependent on resource availability. In case the expected rates of inclusion or follow-up responses are lower than anticipated, we will consider extending the implementation periods to increase participant enrollment.
Participating primary care staff
Primary care staff members including physicians, nurses, mental health staff, and management at each PCC will be provided with written information about the study. Those who agree to participate will complete questionnaires assessing work environment and PCBH implementation aspects and may be invited to participate in focus groups.
Measures and assessments
Measures and assessments are categorized into implementation, organization, and patient levels. These will be collected through administrative systems, medical records, national registers, staff and patient self-report forms (primarily via a digital platform, via phone when needed) as well as semi-structured interviews conducted by independent research personnel. Table 1 provides an overview of all patient-level self-report questionnaires and timepoints. To enhance participant retention, automated text message reminders are sent for each assessment. Trained research assistants will also proactively contact patients who have not completed their assessments via phone. For participants who wish to discontinue due to time constraints, the option of completing a shorter assessment that includes the most important questionnaires will be provided. As a final option, they will be given the opportunity to complete only the primary patient outcome assessment over the phone.
Implementation outcomes
Overall categorical PCBH model fidelity
To assess fidelity, implementation measures (see Model adherence, obstacles, and facilitators) and semi-structured interviews with PCC managers will be used. Three fidelity levels are established: FID1 represents no PCBH implementation, FID2 represents partial PCBH implementation, and FID3 represents adequate PCBH implementation. Two of the authors (AFvC, JLL), along with independent PCBH experts and supervisors, will determine the timepoints when each PCC transitions between fidelity levels. The primary outcome is the time taken for a PCC to reach FID3 level. Secondary outcomes include whether a PCC reaches FID3 within the preset implementation period and the time taken to reach FID2 level. These categories will be used as a base for some analyses, including the primary analysis for organizational and patient level data (see Data Analysis Plan).
Implementation success
The s-NoMAD questionnaire, which evaluates the integration of complex interventions into daily practice [65], will be administered to nurses, physicians, mental health workers, and leaders to assess implementation success.
Acceptability, appropriateness and feasibility
The Acceptability of Intervention Measure (AIM), Intervention Appropriateness Measure (IAM), and Feasibility of Intervention Measure (FIM) [66] are four-item measures of implementation outcomes that are considered particularly relevant to implementation success [67]. Profession-specific versions of these will be administered to nurses, physicians, mental health workers and leaders, focusing on key elements of the PCBH model that are particularly relevant to their daily work.
Model adherence, obstacles, and facilitators
-
Average Appointment Length (AAL) assesses the average duration of bookable appointments in mental health workers’ schedules, measured in minutes.
-
Supply of Appointments (SA) measures the number of bookable appointments available per full-time mental health worker on a weekly basis and reflects the capacity and availability of PCBH services.
-
Future Capacity (FC) indicates the number of available timeslots for appointments in the coming 4 weeks divided by the total number of timeslots in mental health staff schedules. It provides insights into the PCC’s ability to accommodate new patients.
-
Percentage Longer Treatments (PLT) indicates the proportion of patients who have exceeded the standard number of visits (more than 4), signaling a departure from usual PCBH routine.
-
The Primary Care Behavioral Health Provider Adherence Questionnaire (PPAQ) [68] assesses the adherence of behavioral health providers to the PCBH model. For this study, it was adapted for the Swedish setting, incorporating forward and backward translation, the addition of new items, and the removal of irrelevant items. To address the teamwork aspect of PCBH, similar questionnaires were developed for physicians and nurses in collaboration with Swedish PCBH experts, utilizing item-level Content Validity Index ratings [69]. The resulting scales are named Integrated Behaviors in Primary Care for General Practitioners / Mental Health / Registered Nurses (IBPC-GP, -MH, -RN).
-
Levels of Integration Measure (LIM) [70] evaluates healthcare leaders’ perception of the PCC’s integration level regarding behavioral health staff. Similar to the PPAQ, adaptations have been made to reflect its use in the Swedish healthcare system.
In addition to these measures, PCBH supervisors will provide ratings and structured qualitative descriptions of each PCC’s progress in the implementation process after every supervision meeting. This feedback will capture the supervisors’ perspectives on obstacles and facilitators encountered during the local implementation processes.
.
Organizational outcomes
Measures relevant to patient reach
The penetration rate indicates the number of unique patients seen per full-time equivalent mental health professional and will be measured in relation to all listed patients (PR1) as well as patients with a mental health diagnosis (PR2).
Work environment and teamwork among staff
To evaluate any changes in staff work environment, 35 items from the Copenhagen Psychosocial Questionnaire (COPSOQ-III) [71], a measure of psychosocial work environment, will be administered to participating staff. The subscales of Consensus and Collaboration of the IBPC-GP, -RN and -MH scales will be used to measure teamwork at the PCC.
Measures relevant of access of care and wait times
-
Average waiting time (AWT, primary organizational outcome) captures the waiting time from the identification of a behavioral health concern to being seen by any clinician. It includes the time between the patient’s initial contact (phone call or message) and the visit with any clinician. If the concern is identified during another visit, the wait time is calculated from the visit where the need was identified to the visit with the referred-to profession.
-
Average waiting time for a psychosocial intervention (AWT-P) focuses specifically on the waiting time from the identification of a behavioral health concern to receiving any mental health intervention.
-
Number of individuals on waiting lists to receive psychosocial interventions (WL).
-
Third Next Available Appointment (TNAA) assesses the waiting time until the third next available appointment for a hypothetical patient who contacts the PCC on a given day. It is measured consistently at the same time every week (e.g., Mondays at 9 AM). TNAA provides insights into the access and availability of care, independent of patients’ own ability to show up at a given time.
-
Average number of visits and phone/video contacts during patients’ period of care.
Cost, health economics and utilization of medication and sick leave
Utilization of medical care and productivity losses will be measured using the Trimbos and iMTA questionnaire on Costs associated with Psychiatric Illness (TiC-P). This includes assessing the number of days on sick leave, productivity loss while at work, productivity loss at home, and medications prescribed and taken. The 5-item Eq. 5D will be administered for health economic evaluations. Cancelled Visits and No-Shows (CVNS) will be tracked, capturing the number of visits where patients either cancelled late or did not show up. Specialist Referrals (SR) will be recorded as the percentage of patients referred to specialized care and Denied Referrals (DR) will indicate how many of these referrals were not accepted. Patient self-reports will be complemented and combined with national register-level data on sick leave, medications, and health care utilization.
Patient outcomes
The main time-points for all non-register patient measurements are as follows:
-
Before or shortly after first contact with the PCC. This is considered the pre-measure timepoint.
-
4-week follow-up (FU4).
-
8-week follow-up (FU8).
-
12-week follow-up (FU12). This timepoint is considered post-measure when applicable.
-
One year follow-up (FU52).
Sociodemographic and clinical data
Social and economic status, education, profession, and employment/activity status will be collected through self-report. The main reason for the visit, the duration of the problem, other health concerns, concomitant care, care consumption, ICD-10 diagnoses and medications will be captured through self-reports and medical records.
Everyday functioning, symptoms, and quality of life
The primary patient outcome is everyday functioning, assessed through four domains (8 out of 12 items) of the WHO Disability Assessment Schedule 2.0 (WHODAS-12) [72]: Life activities, Cognition, Getting along, and Participation. The domains of Mobility and Self-care, which form independent factors and are not expected to change significantly, will be excluded from primary analyses but considered in secondary analyses. A range of very short versions of well-established patient-rated scales for common mental health conditions will be used to measure symptoms. For an overview, see Table 1. Each scale will be used to evaluate changes to the specific symptoms measured, as well as for dividing patients into different analysis groups based on problem areas. Additionally, a total index for symptom load will be calculated from all 21 items, with appropriate weighting to account for the varying number of questions across domains. Quality of Life will be measured by the 12-item Brunnsviken Brief Quality of Life (BBQ) [73], which examines the importance and fulfilment of six areas (e.g. spare time quality, creative work, and friendship). Additionally, the 4-item Outcome Rating Scale (ORS) [74] will be used. Complementing these measures is the DAily Routines for Well-being INventory (DARWIN), developed by the research group, which evaluates the frequency of 11 behaviors relevant to mental health, including exercise, regular eating, socializing, and sleep hygiene.
Change, adverse events and satisfaction with care
Patient experiences and perceptions will be assessed using multiple measures. Satisfaction will be evaluated using 4 items from the Client Satisfaction Questionnaire (CSQ) [75], the Session Rating Scale (SRS) [76], and 9 additional items specifically designed for PCBH settings to gauge patients’ perceptions of and attitudes toward their care providers. To measure subjective change, the one-item Patient Global Impression - Improvement (PGI-I) [77] scale will be employed. To assess treatment side effects, an Adverse Events questionnaire will be employed, offering both a concise (3 items) and a more extensive version (9 items) at different timepoints, in which patients will have the opportunity to report and describe any unwanted treatment effects or events they may have experienced. Additionally, at the FU12 timepoint, patients will be offered the opportunity to participate in semi-structured interviews to provide detailed insights on their satisfaction, adverse events, treatment content, goals, and perceived changes in symptoms and quality of life. Any adverse events that require immediate action will be reported to the responsible PCC.
Treatment content
Information on which interventions are used within each primary care model will be obtained through medical records. In addition, patients will be asked in interview form what interventions they remember and which strategies they use after treatment.
Primary care models
Care as usual (CAU)
CAU refers to the currently most common way of organizing behavioral and psychological care in Sweden. In accordance with this, all CAU centers, in this study the DELAYED arm, will have on-site clinical psychologists or social workers delivering a variety of talking treatments. Crucially, these functions will not be integrated into the PCC’s workflow but will function as co-located mental health services, in line with the traditional model for delivering psychosocial interventions [19]. Typical routines at CAU centers will involve written referrals from physicians, no direct triage to mental health services and caregivers managing their own schedules and bookings. Interdisciplinary collaboration, if present, is typically done only through scheduled team conferences. Productivity as well as the reach of interventions in relation to mental health is ordinarily low, resulting in extensive wait times and queued referrals. The content of psychological treatment within the CAU model will vary depending on the staff present at each PCC, from supportive counseling to manualized CBT and long-term psychodynamic psychotherapies. The actual content of an individual patient’s care will be assessed retroactively through medical records. Semi-structured interviews with PCC managers will be used to assess that no PCCs in the CAU condition have workflows that are reminiscent of PCBH.
Primary Care Behavioral Health (PCBH)
An obstacle to high quality PCBH research is that there is a variation in the understanding of the aim and key strategies of the model [59]. In this project, a version of the PCBH model adjusted for the Swedish health care system [15] will be used. The focus of the implementation effort is to increase access and decrease wait times for mental health interventions as well as increase collaboration between psychologists/social workers and medical staff. The planned changes include introducing direct triage, same-day appointments, clinical pathways, and a stepped care model for interventions as well as shortening appointment lengths and increasing productivity. Importantly, the typical PCBH routine of ‘warm hand-offs’ (patients being offered a visit with a mental health professional directly after a visit with a primary care physician) [22] will not be emphasized, as Swedish health care increasingly leans on direct triage, where the physician visit is postponed or replaced entirely [78]. Another aim is to increase the efficiency of interprofessional collaboration by defining and clarifying the role of the mental health staff, educating other professions in when and how to utilize their services as well as introducing a common language and mindset for discussing mental health issues with both patients and colleagues. Routine coordination, efforts to reach a shared understanding among staff and quick ‘curbside consultations’ will be emphasized over scheduled team conferences. Mental health staff will be taught to assess patients’ problems through a contextual rather than a medical model of mental health and administer brief interventions adapted to the patients’ problem and life situation, as described in the introduction. All mental health staff will receive three days of training followed by six 4-hour supervision sessions over the course of six months. Training and supervision will focus on both organizational and clinical aspects of the model. Additional support for individual PCCs will be considered in the case of low model fidelity. A local implementation group will be established at each PCC, consisting of all mental health staff, managers as well as representatives for physicians, nurses, and other relevant occupations. All other staff will receive 2 hours of training. All training and supervision will be conducted by an external part. One of the authors (JLL) will together with research assistants oversee adherence by monitoring implementation outcomes (see Model adherence, obstacles, and facilitators) and giving feedback and recommendations to PCC managers and PCBH supervisors. No additional auditing is planned.
Data management, monitoring and confidentiality
Data will primarily be collected through and stored in encrypted form in the study technical platform and database (BASS4) provided by Karolinska Core Facilities. Patients and staff fill in questionnaires online. Data are then stored behind two-factor verification and accessible only to selected research personnel. Data collected through means other than self-report forms will be manually entered into BASS4 by research assistants. All data entry is done in premade templates, ensuring that data are in a proper format and within an expected range of values. Any data coding is done according to standardized coding practices. When data collection is finished, all data will be pseudonymized and key coded. Only the principal investigator and university archivists will be able to access the key. Other project team members will only be able to access pseudonymized data. Considering the nature of the trial, which primarily involves data collection from routine clinical practice and presents a low anticipated risk to participants and given that data monitoring for psychological intervention trials is not mandatory in Sweden, we decided to forgo a data monitoring committee due to costs.
Data analysis plan
We are planning to conduct one main analysis for each of the primary outcomes at each level, a range of explorative and longitudinal analyses for the implementation-level outcomes, and several secondary analyses for the organizational- and patient-level outcomes. Primarily, we aim to confirm that the EARLY arm reaches adequate fidelity level faster than the DELAYED arm and to capture the randomized controlled effects of PCBH on organization- and patient-level outcomes when it has reached adequate model fidelity during the first implementation period (corresponding to an implemented-per-protocol perspective). We also want to evaluate the controlled effects of intending to implement PCBH regardless of what level of fidelity each PCC reaches (corresponding to an intent-to-implement perspective) and the non-controlled (i.e., not comparing the randomized groups) relation between reaching adequate model fidelity and outcomes (corresponding to an adherence-effect or dose-response perspective). No interim analyses are planned.
Implemented-per-protocol analyses:
-
1.
PCCs in EARLY, from when they have reached FID3, compared to all PCCs in DELAYED, during period 1 (main analysis).
-
2.
As (1), but also including data from period 2 in EARLY (but not in DELAYED), to control for the event of PCCs needing extended time to reach FID3, thus lowering the power of the main analysis.
Intent-to-implement analyses:
-
3.
All PCCs regardless of model fidelity in EARLY compared to all PCCs in DELAYED during period 1.
-
4.
As (3), but for periods 1 and 2.
Adherence-response analyses (not controlled by randomization):
-
5.
All PCCs, regardless of arm, when in FID3 during period 1 or 2, compared to PCCs in DELAYED during period 1.
-
6.
As (5), but compared to all PCCs before they reach FID3.
Sensitivity analyses
To control for the lack of an objective cutoff for reaching adequate PCBH, sensitivity analyses of the above tests will be conducted where both FID2 and FID3 are used to define adequate PCBH. In addition, sensitivity analyses will also be performed to manage possible inherent differences in the timing of patient pre-measures. Due to the sometimes fast-paced nature of primary care and the naturalistic study design, patients will at times fill in pre-treatment self-report forms after a first visit rather than before. As such, sensitivity analyses will be conducted to see if the temporal relation between pre-treatment measures and initial visit influences the result.
Statistical tests
Hierarchical Linear Models and Generalized Estimating Equations will be the primary statistical methods used. Missing data will be addressed through appropriate imputation methods that align with the missing data mechanism and account for the multilevel structure of the data. Alternatively, statistical techniques capable of handling missing data, such as multilevel models, will be employed for analysis. The analyses will take into account the multilevel structure of the data, e.g. nesting patients under PCC for patient outcomes. For Health Economic Analyses, effectiveness will be estimated by the construction quality-adjusted life-years (QALYs) based on EQ-5D. Incremental cost-effectiveness ratios (ICERs) will be computed and Monte Carlo simulation with non-parametric bootstrapping will be performed to account for the uncertainty of the ICER point estimates. Cost-effectiveness acceptability curves (CEACs) will be used to explore cost-effectiveness under varying willingness to pay-circumstances.
Discussion
The main purpose of the current project is to strengthen the evidence base for the effects that PCBH has on implementation-, organization-, and patient-level outcomes. Implementation of a primary care model such as PCBH needs to be studied in a naturalistic setting, which reduces the possibility for rigorous research procedures and high levels of control. In addition, implementing PCBH is a large undertaking that requires systematic changes on both an organizational and an individual level – processes that are highly dependent on the local context and difficult to control. The implementation in this study is initiated by an external stakeholder, Närhälsan, and performed by a publicly procured company. As such, we as researchers have little control over the specifics of training and supervision, as well as over which PCCs participate in the project, how these are chosen, and their internal contexts and readiness for change. This means that the model fidelity categorization is an essential aspect – especially as many measurements and analyses are hierarchically dependent on each other. Patient outcomes (such as everyday functioning and satisfaction with care) may be partly dependent on organizational outcomes (such as waiting time until first visit) and they are both dependent on implementation outcomes (such as acceptance of and adherence to PCBH routines).
We have designed this study in an effort to evaluate the causal effects of PCBH despite these complex aspects. We have identified relevant measures and divided them into the three hierarchical levels described above. The data analysis plan has been designed to primarily utilize the randomized controlled design from both a per-protocol perspective (focusing on PCCs with successful implementation) and an intent-to-implement perspective (focusing on all PCCs in the EARLY implementation group regardless of which model fidelity category they reach). These analyses are complemented by secondary analyses based only on model fidelity and its association with outcomes, ignoring the randomized design but providing an opportunity of an equivalent of a dose-response analysis. Finally, in case we do not establish superiority for PCBH on the patient-level primary outcome, we will also execute non-inferiority analyses. In total, this results in a large number of planned analyses, but we deem this to be necessary to manage the complexities described above.
The results of this project will be helpful in guiding decisions on how to organize the delivery of behavioral interventions and psychological treatment within the context of primary care in Sweden and elsewhere. As the project is carried out within regular healthcare the external validity is very high, with only a minor gap between research and practice.
Current trial status
Implementation period 1 started in January 2022. Patients will be included until December 31st 2023, and the last participant is expected to reach the final endpoint (one-year follow-up) in December 2024. Data analysis will begin in May 2024.
Data availability
Data are available upon reasonable request, subject to the requirement that approval from the involved health care services may be necessary for each separate request. Due to the sensitive nature of the data, only fully anonymized data can be made available. Requests can be made to ORCID iD 0000-0002-6443-5279. The approved ethics application is available in Swedish upon request without any conditions.
Abbreviations
- CAU:
-
Care As Usual
- FID1, -2, -3:
-
Model Fidelity Category 1, 2, 3
- KTA:
-
Karolinska Trial Alliance
- PCBH:
-
Primary Care Behavioral Health
- PCC:
-
Primary Care Center
References
WHO & Wonca Working Party on Mental Health. What is primary care mental health? Ment Health Fam Med. 2008;5(1):9–13.
Allgulander C, Nilsson B. Var fjärde patient lider av ångest och depression. Läkartidningen. 2003;100(10):7.
Sartorius N, Ustün TB. Mental illness in general health care: an international study [Internet]. Chichester: Wiley; 1995 [cited 2022 Jul 12]. Available from: https://apps.who.int/iris/handle/10665/36937.
Wittchen HU, Mühlig S, Beesdo K. Mental disorders in primary care. Dialogues Clin Neurosci. 2003;5(2):115–28.
Alonso J, Petukhova M, Vilagut G, Chatterji S, Heeringa S, Üstün TB, et al. Days out of role due to common physical and mental conditions: results from the WHO World Mental Health surveys. Mol Psychiatry. 2011;16(12):1234–46.
Connell J, Brazier J, O’Cathain A, Lloyd-Jones M, Paisley S. Quality of life of people with mental health problems: a synthesis of qualitative research. Health Qual Life Outcomes. 2012;10(1):138.
OECD. Sick on the Job? Myths and Realities about Mental Health and Work [Internet]. Paris: Organisation for Economic Co-operation and Development; 2012 [cited 2022 Jul 22]. Available from: https://www.oecd-ilibrary.org/social-issues-migration-health/mental-health-and-work_9789264124523-en.
Försäkringskassan. Uppföljning av sjukfrånvarons utveckling 2020. Svar på regeringsuppdrag dnr 015100 – 2019. Stockholm: Försäkringskassan; 2020. p. 143.
Patel V, Chatterji S. Integrating Mental Health in Care for Noncommunicable Diseases: an imperative for person-centered care. Health Aff Proj Hope. 2015;34(9):1498–505.
Katon W, Lin EHB, Kroenke K. The association of depression and anxiety with medical symptom burden in patients with chronic medical Illness. Gen Hosp Psychiatry. 2007;29(2):147–55.
World Health Organization. The World Health Report 2008: primary Health Care now more Than ever. Geneva: World Health Organization; 2008.
Bloom DE, Cafiero E, Jané-Llopis E, Abrahams-Gessel S, Bloom LR, Fathima S et al. The Global Economic Burden of Noncommunicable Diseases. PGDA Working Papers. Geneva: World Economic Forum; 2011. (PGDA Working Papers). Report No.: 8712.
World Health Organization. Integrating mental health into primary care. Geneva: World Health Organization; 2008.
World Health Organization. The WHO Special Initiative for Mental Health (2019–2023): Universal Health Coverage for Mental Health. Geneva: World Health Organization; 2019.
Silberleitner N, von Farnsworth A, Robinson PJ. Integrerad primärvård: principer, färdigheter och rutiner för hela vårdcentralens arbete med beteenderelaterad ohälsa. Stockholm: Natur & Kultur; 2021.
Strosahl K, Robinson PA, Gustavsson T. Brief interventions for radical change: principles & practice of focused acceptance & commitment therapy. Oakland, CA: New Harbinger Publications; 2012.
Statens offentliga utredningar. God och nära vård – Rätt stöd till psykisk hälsa (SOU 2021:6). Stockholm: Socialdepartementet; 2021. p. 414.
Socialstyrelsen. Nationella Riktlinjer för vård vid depression och ångestsyndrom. Stockholm: Socialstyrelsen; 2017. p. 109.
Kazdin AE. Addressing the treatment gap: a key challenge for extending evidence-based psychosocial interventions. Behav Res Ther. 2017;88:7–18.
Åsbring N, Dal H, Ohrling M, Dalman C. Var femte som besökte vårdcentral fick hjälp mot psykisk ohälsa. Läkartidningen. 2014;40.
World Health Organization. World mental health report: Transforming mental health for all [Internet]. Geneva; 2022 [cited 2023 Aug 18]. Available from: https://www.who.int/publications-detail-redirect/9789240049338.
Reiter JT, Dobmeyer AC, Hunter CL. The Primary Care Behavioral Health (PCBH) model: an overview and operational definition. J Clin Psychol Med Settings. 2018;25(2):109–26.
Bridges AJ, Gregus SJ, Rodriguez JH, Andrews AR, Villalobos BT, Pastrana FA, et al. Diagnoses, intervention strategies, and rates of functional improvement in integrated behavioral health care patients. J Consult Clin Psychol. 2015;83(3):590–601.
Sadock E, Auerbach SM, Rybarczyk B, Aggarwal A. Evaluation of integrated psychological services in a university-based primary care clinic. J Clin Psychol Med Settings. 2014;21(1):19–32.
Sawchuk CN, Craner JR, Berg SL, Smyth K, Mack J, Glader M, et al. Initial outcomes of a real-world multi-site primary care psychotherapy program. Gen Hosp Psychiatry. 2018;54:5–11.
Funderburk JS, Sugarman DE, Labbe AK, Rodrigues A, Maisto SA, Nelson B. Behavioral health interventions being implemented in a VA primary care system. J Clin Psychol Med Settings. 2011;18(1):22–9.
Bridges AJ, Andrews AR, Villalobos BT, Pastrana FA, Cavell TA, Gomez D. Does Integrated Behavioral Health Care Reduce Mental Health Disparities for latinos? Initial findings. J Lat Psychol. 2014;2(1):37–53.
Bryan CJ, Morrow C, Appolonio KK. Impact of behavioral health consultant interventions on patient symptoms and functioning in an integrated family medicine clinic. J Clin Psychol. 2009;65(3):281–93.
Bryan CJ, Corso ML, Corso KA, Morrow CE, Kanzler KE, Ray-Sannerud B. Severity of mental health impairment and trajectories of improvement in an integrated primary care clinic. J Consult Clin Psychol. 2012;80(3):396–403.
Cigrang JA, Dobmeyer AC, Becknell ME, Roa-Navarrete RA, Yerian SR. Evaluation of a collaborative mental health program in primary care: effects on patient distress and health care utilization. Prim Care Community Psychiatry. 2006;11(3):121–7.
Cigrang JA, Rauch SAM, Mintz J, Brundige A, Avila LL, Bryan CJ, et al. Treatment of active duty military with PTSD in primary care: a follow-up report. J Anxiety Disord. 2015;36:110–4.
Corso KA, Bryan CJ, Corso ML, Kanzler KE, Houghton DC, Ray-Sannerud B, et al. Therapeutic alliance and treatment outcome in the primary care behavioral health model. Fam Syst Health J Collab Fam Healthc. 2012;30(2):87–100.
Davis D, Corrin-Pendry S, Savill M. A follow-up study of the long-term effects of counselling in a primary care counselling psychology service. Couns Psychother Res. 2008;8(2):80–4.
Gomez D, Bridges AJ, Andrews AR III, Cavell TA, Pastrana FA, Gregus SJ, et al. Delivering parent management training in an integrated primary care setting: description and preliminary outcome data. Cogn Behav Pract. 2014;21(3):296–309.
Goodie JL, Isler WC, Hunter C, Peterson AL. Using behavioral health consultants to treat insomnia in primary care: a clinical case series. J Clin Psychol. 2009;65(3):294–304.
McFeature B, Pierce T. Primary care behavioral Health Consultation reduces depression levels among Mood-Disordered patients. J Health Disparities Res Pract. 2012;5(2).
Ray-Sannerud BN, Dolan DC, Morrow CE, Corso KA, Kanzler KE, Corso ML, et al. Longitudinal outcomes after brief behavioral health intervention in an integrated primary care clinic. Fam Syst Health J Collab Fam Healthc. 2012;30(1):60–71.
Wilfong KM, Goodie JL, Curry JC, Hunter CL, Kroke PC. The impact of brief interventions on functioning among those demonstrating anxiety, depressive, and Adjustment disorder symptoms in primary care: the effectiveness of the Primary Care Behavioral Health (PCBH) model. J Clin Psychol Med Settings. 2022;29(2):318–31.
Bogucki OE, Craner JR, Berg SL, Miller SJ, Wolsey MK, Smyth KT, et al. Cognitive behavioral therapy for depressive disorders: outcomes from a multi-state, multi-site primary care practice. J Affect Disord. 2021;294:745–52.
Bogucki OE, Craner JR, Berg SL, Wolsey MK, Miller SJ, Smyth KT, et al. Cognitive behavioral therapy for anxiety disorders: outcomes from a Multi-State, multi-site primary care practice. J Anxiety Disord. 2021;78:102345.
Reppeto H, Tuning C, Olsen DH, Mullane A, Smith C. Triple Aim: benefits of behavioral health providers in primary care. J Health Psychol. 2021;26(2):205–13.
Cummings NA, O’Donohue WT, Cummings JL. The financial dimension of integrated behavioral/primary care. J Clin Psychol Med Settings. 2009;16(1):31–9.
Monson SP, Sheldon JC, Ivey LC, Kinman CR, Beacham AO. Working toward financial sustainability of integrated behavioral health services in a public health care system. Fam Syst Health J Collab Fam Healthc. 2012;30(2):181–6.
Landoll RR, Nielsen MK, Waggoner KK, Najera E. Innovations in primary care behavioral health: a pilot study across the U.S. Air Force. Transl Behav Med. 2019;9(2):266–73.
Serrano N, Monden K. The effect of behavioral health consultation on the care of depression by primary care clinicians. WMJ off Publ State Med Soc Wis. 2011;110(3):113–8.
Gouge N, Polaha J, Rogers R, Harden A. Integrating behavioral health into Pediatric Primary Care: implications for Provider Time and cost. South Med J. 2016;109(12):774–8.
Lanoye A, Stewart KE, Rybarczyk BD, Auerbach SM, Sadock E, Aggarwal A, et al. The Impact of Integrated Psychological Services in a Safety Net Primary Care Clinic on Medical utilization. J Clin Psychol. 2017;73(6):681–92.
Funderburk JS, Fielder RL, DeMartini KS, Flynn CA. Integrating behavioral health services into a university health center: patient and provider satisfaction. Fam Syst Health J Collab Fam Healthc. 2012;30(2):130–40.
Torrence ND, Mueller AE, Ilem AA, Renn BN, DeSantis B, Segal DL. Medical provider attitudes about behavioral health consultants in integrated primary care: a preliminary study. Fam Syst Health J Collab Fam Healthc. 2014;32(4):426–32.
Angantyr K, Rimner A, Nordén T, Norlander T. Primary care behavioral health model: perspectives of outcome, client satisfaction, and gender. Soc Behav Personal Int J. 2015;43(2):287–302.
Zubatsky M, Pettinelli D, Salas J, Davis D. Associations between Integrated Care Practice and Burnout factors of Primary Care Physicians. Fam Med. 2018;50(10):770–4.
Ogbeide SA, Landoll RR, Nielsen MK, Kanzler KE. To go or not go: patient preference in seeking specialty mental health versus behavioral consultation within the primary care behavioral health consultation model. Fam Syst Health J Collab Fam Healthc. 2018;36(4):513–7.
Pomerantz AS, Shiner B, Watts BV, Detzer MJ, Kutter C, Street B, et al. The White River model of colocated collaborative care: a platform for mental and behavioral health care in the medical home. Fam Syst Health J Collab Fam Healthc. 2010;28(2):114–29.
Pomerantz A, Cole BH, Watts BV, Weeks WB. Improving efficiency and access to mental health care: combining integrated care and advanced access. Gen Hosp Psychiatry. 2008;30(6):546–51.
Hunter CL, Funderburk JS, Polaha J, Bauman D, Goodie JL, Hunter CM. Primary Care Behavioral Health (PCBH) model research: current state of the science and a call to action. J Clin Psychol Med Settings. 2018;25(2):127–56.
Possemato K, Johnson EM, Beehler GP, Shepardson RL, King P, Vair CL, et al. Patient outcomes associated with primary care behavioral health services: a systematic review. Gen Hosp Psychiatry. 2018;53:1–11.
Lau R, Stevenson F, Ong BN, Dziedzic K, Treweek S, Eldridge S, et al. Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews. Implement Sci. 2016;11(1):40.
Serrano N, Cordes C, Cubic B, Daub S. The state and future of the primary care behavioral health model of Service Delivery workforce. J Clin Psychol Med Settings. 2018;25(2):157–68.
Sunderji N, Polaha J, Ratzliff A, Reiter J. A walk on the translational science bridge with leaders in integrated care: where do we need to build? Fam Syst Health. 20200611;38(2):99.
Funderburk JS, Polaha J, Beehler GP. What is the recipe for PCBH? Proposed resources, processes, and expected outcomes. Fam Syst Health. 20211216;39(4):551.
Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 Statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.
Eldridge SM, Ashby D, Feder GS, Rudnicka AR, Ukoumunne OC. Lessons for Cluster randomized trials in the twenty-first century: a systematic review of trials in primary care. Clin Trials Lond Engl. 2004;1(1):80–90.
Saltychev M, Katajapuu N, Bärlund E, Laimi K. Psychometric properties of 12-item self-administered World Health Organization disability assessment schedule 2.0 (WHODAS 2.0) among general population and people with non-acute physical causes of disability - systematic review. Disabil Rehabil [Internet]. 2021 Mar [cited 2023 Jun 15];43(6). Available from: http://pubmed.ncbi.nlm.nih.gov/31335215/.
Cuijpers P, Turner EH, Koole SL, van Dijke A, Smit F. What is the threshold for a clinically relevant effect? The case of major depressive disorders. Depress Anxiety [Internet]. 2014 May [cited 2023 Jun 15];31(5). Available from: http://pubmed.ncbi.nlm.nih.gov/24677535/.
Elf M, Nordmark S, Lyhagen J, Lindberg I, Finch T, Åberg AC. The Swedish version of the normalization process theory measure S-NoMAD: translation, adaptation, and pilot testing. Implement Sci. 2018;13(1):146.
Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci IS. 2017;12:108.
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, Measurement challenges, and Research Agenda. Adm Policy Ment Health. 2011;38(2):65–76.
Beehler GP, Funderburk JS, Possemato K, Dollar KM. Psychometric assessment of the primary care behavioral health provider adherence questionnaire (PPAQ). Transl Behav Med. 2013;3(4):379–91.
Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459–67.
Staab EM, Terras M, Dave P, Beckman N, Shah S, Vinci LM, et al. Measuring Perceived Level of Integration during the process of primary care behavioral health implementation. Am J Med Qual. 2018;33(3):253–61.
Berthelsen H, Westerlund H, Bergström G, Burr H. Validation of the Copenhagen Psychosocial Questionnaire Version III and establishment of Benchmarks for Psychosocial Risk Management in Sweden. Int J Environ Res Public Health. 2020;17(9):3179.
Üstün T, Kostanjsek N, Chatterji S. Measuring Health and disability: Manual for WHO Disability Assessment schedule WHODAS 2.0. Geneva: World Health Organization; 2010.
Lindner P, Frykheden O, Forsström D, Andersson E, Ljótsson B, Hedman E, et al. The Brunnsviken brief quality of Life Scale (BBQ): development and psychometric evaluation. Cogn Behav Ther. 2016;45(3):182–95.
Miller SD, Duncan BL, Brown J, Sparks JA, Claud DA. The Outcome Rating Scale: a preliminary study of the reliability, validity, and feasibility of a brief visual Analog measure. J Brief Ther. 2003;2(2):10.
Attkisson CC, Zwick R. The client satisfaction questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plann. 1982;5(3):233–7.
Duncan BL, Miller SD, Sparks JA, Claud DA, Reynolds LR, Brown J et al. The Session Rating Scale: preliminary psychometric properties of a Working Alliance measure. J Brief Ther. 2003;3.
Mohebbi M, Dodd S, Dean OM, Berk M. Patient centric measures for a patient centric era: agreement and convergent between ratings on the patient global impression of improvement (PGI-I) scale and the clinical global impressions – improvement (CGI-S) scale in bipolar and major depressive disorder. Eur Psychiatry. 2018;53:17–22.
Thorn J, Maun A, Bornhöft L, Kornbakk M, Wedham S, Zaffar M, et al. Increased access rate to a primary health-care centre by introducing a structured patient sorting system developed to make the most efficient use of the personnel: a pilot study. Health Serv Manage Res. 2010;23(4):166–71.
Acknowledgements
We would like to acknowledge Närhälsan as well as FoU Primär och nära vård i Västra Götalandsregionen for making this study possible. We also want to express our gratitude to Jodi Polaha, Patti Robinson, and Kirk Strosahl for your help in the early planning of the study. Thank you to Nicola Silberleitner, Mattias Myrälf, Mats Dahlin and David Gryphon for the ongoing consultation as part of the PCBH Expert Group. Most importantly, we extend our deepest appreciation to all health care staff and patients who will be participating in the trial for their time and contributions.
Funding
This work is supported by the Kamprad Family Foundation for Entrepreneurship, Research and Charity (2019–2024), Research and Development Primary Healthcare Regional Funds in Västra Götalandsregionen (2021–2022), Karolinska Institute Funds (2020–2021), Capio Närsjukvård (2019–2027), the Swedish Research Council (2021–06481), and the regional agreement on medical training and clinical research (ALF) between Karolinska Institutet and Region Stockholm (FoUI-977722). The study funders have not and will not be involved in designing the study; collecting, managing, analyzing, or interpreting data; writing reports; or making decisions around submitting reports for publication.
Open access funding provided by Linnaeus University.
Author information
Authors and Affiliations
Contributions
AFvC: Writing – Original Draft, Writing – Review & Editing, Project Administration. JLL: Writing – Original Draft, Project Administration, Funding acquisition. NHI: Methodology, Software, Writing – Review & Editing. VK: Conceptualization, Funding acquisition, Supervision, Writing – Review & Editing.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study was approved by the Swedish Ethical Review Board (reference number 2020–04198) in Uppsala. This study was approved by the Swedish Ethical Review Board (reference number 2020–04198) in Uppsala. The trial is conducted in accordance with all relevant guidelines and regulations, the Declaration of Helsinki, and Good Clinical Practice (GCP). Informed consent is obtained from all participants after written information has been made available and the patient has had the chance to discuss with a research assistant over the phone. The results from the study will be presented so that no individuals, neither patients nor staff, will be identifiable. All results will be presented on a group level. All participation is voluntary, and the participants can withdraw from the study at any time.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Farnsworth von Cederwald, A., Lilja, J.L., Hentati Isacsson, N. et al. Primary Care Behavioral Health in Sweden – a protocol of a cluster randomized trial evaluating outcomes related to implementation, organization, and patients (KAIROS). BMC Health Serv Res 23, 1188 (2023). https://doi.org/10.1186/s12913-023-10180-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12913-023-10180-9