Abstract
Background
General practice is often recommended as an ideal setting to initiate advance care planning (ACP), but uptake of ACP in this setting is low. ACP-GP is a complex intervention to facilitate ACP for patients with chronic, life-limiting illness in Belgian general practice. It aims to increase patient ACP engagement and general practitioner (GP) ACP self-efficacy. In a cluster-randomized controlled trial, the intervention was not superior to control in increasing these outcomes. A parallel process evaluation aimed to enhance understanding of how the intervention was implemented, and which factors might have influenced trial results.
Methods
We conducted a mixed-methods process evaluation following the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework. Data sources include recruitment and implementation monitoring, questionnaires for patients and GPs, and semi-structured (focus group) interviews with patients and GPs. Questionnaire data were analyzed descriptively. Qualitative data were first analyzed inductively; themes were then assigned deductively to RE-AIM dimensions.
Results
Thirty-five GPs and 95 patients were recruited to the trial; GP reach was low. Sixteen GPs and 46 patients provided questionnaire data at 3 months post-baseline; qualitative data were transcribed for 14 GPs and 11 patients. Adoption of intervention components was moderate to good, with the exception of the documentation template for GPs. Interviews revealed varying patient attitudes towards ACP, but patients nonetheless emphasized that conversations made them feel reassured. GPs especially valued a positive framing of ACP. When adopted, the intervention was well-implemented and participant satisfaction was high. However, intention for maintenance was moderate, with GPs raising questions of how to sustainably implement ACP conversations in the future.
Conclusions
Implementing the complex ACP-GP intervention in general practice is feasible, and can be successful. However, the implementation process is challenging and the sustainability is suboptimal. Our findings will guide future research and recommendations for facilitating and implementing ACP in general practice.
Trial registration
ISRCTN12995230; prospectively registered on 19/06/2020.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
Advance care planning (ACP) is an iterative process whereby people communicate with family, loved ones, and health providers about personal values, life goals, and preferences regarding (future) treatment and care [1]. While ACP should not be limited to patients with chronic, life-limiting illness, it plays a crucial role in providing high-quality care for people with such conditions, supporting decision-making regarding future care [2]. Research suggests that patients and the general population perceive ACP as important [3,4,5,6], but uptake remains low, including in general practice [7,8,9]. These findings conflict with recommendations to introduce ACP in a timely manner, for which general practitioners (GPs) are well-situated. Initiating ACP in general practice allows patients to discuss values and wishes for care at a time when their health is relatively stable [10, 11]. GPs can leverage their longstanding relationship with the patient to facilitate these conversations. Such continuity is seen as an important task of GPs in Belgium, who also liaise with palliative home care. Belgian patients with terminal illness also expect their GP to exchange information with specialist care [12]. However, GPs may face barriers to initiating ACP in practice, such as insufficient skills and a lack of time [13,14,15,16].
The ACP-GP intervention was developed to facilitate ACP conversations in Belgian general practice. Following the Medical Research Council (MRC) guidance framework for development of complex interventions [17], barriers and facilitators to ACP in this setting were identified. These included perceived patient factors, such as lack of understanding about ACP; GP factors, such as a lack of confidence and skills to initiate ACP; and system-level factors, such as lack of a place to consistently record patient care wishes [14]. Key intervention components, based on existing literature, were selected to target barriers and support facilitators. The components were refined after expert panel review [18], and further after a pilot study [19]. This yielded the ACP-GP intervention, a complex intervention with four interacting components, which was tested in a cluster-randomized controlled trial (RCT). Briefly, the intervention consisted of (1) GP training in ACP communication; (2) A patient workbook; (3) Two ACP conversations between patient and GP; and (4) A template to document the conversations. (See Additional File 1 for details)
We conducted a cluster-RCT to evaluate whether the intervention was superior to usual care in increasing patient and GP primary outcomes. For patients, we measured ACP engagement with the 15-item ACP Engagement Survey [20]. For GPs, we measured self-efficacy to conduct ACP, using the ACP-Self Efficacy (ACP-SE) scale [21]. At 3 months post-baseline assessment (T1), we found that although outcomes increased in both groups, the intervention group did not increase significantly more than the control group [22].
To open the “black box” of this complex ACP intervention and understand why we observed these outcomes, a thorough process evaluation is necessary [23]. This can aid in distinguishing between problems related to intervention theory, and those associated with intervention delivery [24]. We therefore aim to evaluate experiences with implementation of the intervention, as reported by patients and GPs who participated.
We embedded a process evaluation in the cluster-RCT to enhance our understanding of how the intervention was implemented and interacted with contextual factors, facilitators and barriers encountered during implementation, and how these interacted to influence outcomes. The process evaluation aligns with the (updated) MRC Framework guidance, which emphasizes that complex intervention research can address questions beyond whether the intended outcome is achieved, e.g. by identifying other impacts and assessing the value of the intervention, in light of resource demands [25].
Methods
Design
This process evaluation follows the Reach, Efficacy/Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework [26]. This framework allows researchers to evaluate how and why an intervention works (or not) when implemented in health system settings [27]. It is an intuitive model of evaluation which can be used to consider pragmatic questions of “Who, what, where, how, and when?” to understand key findings when evaluating the intervention [28]. The addition of qualitative assessment in this design also allows exploration of “Why?”, such as by exploring factors influencing adoption or implementation, to complement the above [29].
We conducted this mixed-methods process evaluation, starting from the beginning of recruitment and ending after the 6-month intervention period. We use a sequential design, with quantitative data collection during, and qualitative data collection after, the intervention period [30]. RE-AIM informed the conduct, analysis, and structure of this manuscript. The conceptualization of the RE-AIM dimensions and corresponding data collection are shown in Table 1.
Setting and participants
Participants were recruited in the scope of the cluster-RCT of the ACP-GP intervention in Belgian general practice. Eligible for participation were Belgian GPs and their Dutch-speaking patients with chronic, life-limiting illness (advanced/unresectable cancer, organ failure, frailty), for whom the GP would not be surprised if they were to die within the next 12–24 months. In group GP practices, one GP per practice was included. For more information about the cluster-RCT design, we refer to the published protocol [31].
Data collection
During recruitment, a trial manager and data collectors maintained records of participants contacted and noted reasons for declining participation. Participants completed demographics questionnaires at baseline (T0). The trial manager and data collectors also monitored for adverse events.
All participating GPs and patients were asked to complete questionnaires about their ACP conversations and satisfaction with the intervention, using a self-developed satisfaction questionnaire, at T1, 3 months post-baseline. This timing was chosen because primary effectiveness was measured at T1.
We conducted semi-structured interviews with intervention participants in March-June of 2021. Interview guides with open questions and probes guided data collection (Additional File 2). As we aimed to encourage discussion between GPs about their experiences, we invited GPs to focus groups. If attendance was not feasible, individual interviews were possible. Focus groups were moderated by JS, ADV, and an assisting researcher, and conducted via video conferencing due to COVID-19 restrictions. JS and an assisting researcher individually interviewed a convenience sample of patients by telephone. We interviewed patients individually due to practical constraints and to avoid overburdening patients. Focus groups and interviews were audio-recorded; if recording was not possible, extensive written notes were taken. Recordings were transcribed verbatim and pseudonymized.
Analysis
Questionnaire data were analyzed descriptively in SPSS software (Version 27). To ease interpretation, 7-point Likert scales were reduced to three categories (1–3: low rating or disagreement; 4: neutral rating; 5–7: high rating or agreement).
Qualitative data analyses were based on a content analysis approach, combining inductive and deductive analysis [32]. First, JS and A-LS independently read and inductively coded a selection of transcripts. During meetings, the two authors checked similarities and differences in coding and interpretation before coming to an agreement about a preliminary coding structure. Two coding trees were established, for patients and GPs respectively. JS coded the remaining transcripts in NVivo software (Version 12). Overarching themes were grouped deductively, linking them to the RE-AIM framework dimensions. JS, A-LS, ADV, and KP, held meetings to review the coding structure and achieve consensus about interpretation of key findings.
Results
18 GPs and 53 patients were assigned to the intervention. Sixteen GPs and 46 patients returned questionnaires at T1. After the intervention period, we conducted three focus groups (n = 3, n = 2, n = 5 GPs respectively), and interviewed four GPs individually. Thirteen patients from the intervention group were interviewed. One recording of a patient dyad (married partners both participating in the intervention, interviewed simultaneously) was inaudible and not transcribed, yielding 11 patient transcriptions. Demographics of interviewed participants are show in Table S1 (Additional File 3).
For the qualitative reporting of results, we note that factors affecting adoption (participants making the decision to initiate intervention components) and implementation (how the adopted components are carried out in practice) were often interconnected. Results should be read with this in mind. All qualitative themes and illustrative quotes are shown in Table 2.
Reach (Number, proportion, and representativeness of participants)
1570 GPs affiliated with 837 practices were identified during recruitment (Additional File 4). Of these, 1519 were contacted via telephone, email, and/or leaflet. Of 682 GPs who provided a reason for declining participation, the majority (60.6%) cited a lack of time/being too busy. Fifty GPs (3.3% of GPs contacted) expressed interest and agreement to participate; 35/50 (70% of interested GPs) were enrolled and randomized to intervention (n = 18) or control (n = 17). All enrolled GPs came from unique practices. Reasons for withdrawal prior to randomization included being unable to identify eligible patients for the study and a lack of time.
GPs identified 117 patients for participation, of whom 95 (81.2%) were included. Of 22 patients not included, eight (36.4%) declined or had no interest, and two (9.1%) found the topic too confronting. Baseline characteristics of participants in both groups are shown in Table S2 (Additional File 3).
Perceived factors affecting reach
During interviews, GPs gave varying feedback about the ease of finding eligible patients. Some found limitations to the inclusion criteria (Quote GP1.1). The surprise question was deemed useful in place of a strict age cutoff, but was difficult to apply when patients’ possible future health outcomes were unclear (Quote GP1.2). GPs described how some eligible patients primarily consulted a specialist and not the GP, until they approached the terminal phase (Quote GP1.3). Conversely, patients closer to the end of life were those the GP saw regularly. Finally, some GPs described a selection bias, such as choosing patients with whom they felt comfortable discussing ACP (Quote GP1.4).
Effectiveness (impact of the intervention, including potential negative effects)
For primary effectiveness, we did not find evidence for superiority of the intervention over the control group in improving the patient outcome (ACP engagement) or GP outcome (ACP self-efficacy) [22]. No major adverse events associated with the intervention were reported. Within the complete sample, seven patients died during the trial period, three of whom were in the intervention group.
Perceived added value and impact of the intervention
GPs described how the intervention increased their alertness to ACP and its themes in daily practice. This contributed to GPs’ intention to proactively start conversations (Quote GP2.1). Many GPs described how framing ACP around what is important to the patient to live well, gave them a more positive approach (Quote GP2.2) and helped conversations flow logically. GPs felt this was more fulfilling than an advance directive (AD)-driven approach and it helped some GPs feel more confident and supported.
Conversations facilitated an ACP process where GPs learned valuable information about their patients. GPs explained that they documented topics discussed during and after conversations, sometimes in an AD (Quote GP2.3). As a result of the conversations, GPs felt they would be able to better speak up for the patient’s wishes if the patient became incapacitated, and to articulate this to the patient’s family (Quote GP2.4).
GPs perceived that the workbook and conversations helped patients actively contemplate ACP (Quote GP2.5). However, some GPs described no changes (Quote GP2.6) in their own awareness, knowledge or confidence, as they already had previous experience and found a way of having ACP conversations that worked for them. On the other hand, some GPs felt gaining confidence would first require more practice.
Patients expressed that the intervention helped them think about their future health and care wishes (Quote PT2.1). Several patients described how the results of their conversations with the GP were documented and communicated with involved family members (Quote PT2.2). Multiple patients described a positive affect after the conversations with their GP: conversations assuaged worries and made patients feel reassured that their GP would consider their wishes in future care decisions (Quote PT2.3).
Adoption (Extent of uptake of intervention components by participants)
Training
The GP training consisted of an online module and two live, interactive parts. All GPs registered for the online module. Interactive part one was offered in three sessions. Five GPs attended session 1, five session 2, and six session 3. Two GPs received the session in recorded version. The second interactive part was given in two sessions. Seven GPs attended the first session, eight the second, and three received the session in recorded version.
Training materials were emailed to all GPs and were available online throughout the study period. At T1, most GPs indicated using the materials from the training once or twice (33.3%), or monthly (46.7%); two (12.5%) never used the training materials (Table S3, Additional File 3).
Workbook
All patients received the workbook from research staff. Of 39 respondents at T1, approximately one-third (30.8%) indicated they had never used the workbook (Table S4, Additional File 3). Seventeen patients returned copies of their workbook by the end of the study period (37.8% of 45 patients retained to T2).
Conversations
At their respective T1 assessment, 13/16 GPs (81.3%) reported having had ACP conversations with patients included in the study, and 33/46 patients (71.7%) reported at least one ACP conversation with their GP (Table S5, Additional File 3).
Documentation template
All GPs were provided the documentation template in PDF format. GP questionnaire responses at T1 indicated that 8/30 (26.7%) of first conversations and 1/21 (4.8%) of second conversations were documented using the template. Four GPs returned copies of the template by the end of the study period.
Perceived factors influencing adoption
During interviews, GPs endorsed the value of ACP as something important for them to do, though many acknowledged that it is a delicate topic which also requires patients to be receptive (Quote GP3.1). This attitude facilitated adoption of the intervention as a whole. GPs varied in the extent of uptake of materials. They described how they read the conversation guide to prepare for conversations. However, some indicated not finding added usefulness for the documentation template or lacking integration with their current means of documentation, and therefore did not use the template (Quote GP3.2). One interviewed GP who had been unable to schedule conversations cited a lack of time, exacerbated by the COVID-19 pandemic, as the main barrier. The lack of time hindered planning and preparation. The GP did not wish to schedule conversations under these constraints (Quote GP3.3).
Patients’ affective reactions to ACP, and attitudes towards ACP, could facilitate adoption or act as a barrier. For some patients, hearing or thinking about ACP was confronting and raised negative emotions, or concerns that their health was declining, which made it more difficult to engage with the topic directly (Quote PT3.1). Some patients acknowledged the benefit of ACP generally but did not want to be “pushed” into it, or did not feel it was relevant for them personally yet. Others were supportive of ACP or felt it couldn’t hurt for them to bring it up (Quote PT3.2). Pertaining to perceived relevance, some patients found ACP personally relevant, e.g. due to older age. However, despite engaging with the intervention by reviewing the workbook and/or having conversations with their GP, some patients nonetheless saw ACP as being for older or more dependent persons, or for those with more acute health concerns, and thus did not feel they needed ACP at the moment (Quote PT3.3).
Implementation
Fidelity to protocol
The protocol for the intervention consists of a researcher-delivered part (giving the workbook to patients, delivering the training and conversation materials to GPs, giving the documentation template to GPs), and a part to be implemented by the participants (GPs having two ACP conversations with each patient, GPs filling out the documentation template).
At T1, 22/31 patients (71%) were reported by the GP to have received two conversations, as specified in the protocol. At the moment of their T1 measurement, 14/46 (30.4%) patients reported having had two or more conversations with their GP (Table S5, Additional File 3). Cross-checking GP and patient reports showed that 9/22 patients for whom GPs reported two conversations, also reported having used their workbook at T1. One patient reported using the workbook, had two conversations by T1 as reported by the GP, and had both conversations documented using the template.
Training
Training sessions lasted from 1 h 47 min to 2 h 17 min. In the sessions where GPs conducted practice conversations with model patients, two attending GPs conducted a conversation; other attending GPs gave feedback and participated in group discussions only.
GPs rated the usefulness of and satisfaction with the training and the intervention materials highly (Table S3, Additional File 3). Approximately half (53.3%) did not think the training took too much time. For most GPs (73.4%), the training met or exceeded their expectations. Most (60%) would recommend the training to others, but one-third (33.3%) were unsure.
Workbook, conversations, documentation
Conversations with the GP met (77.4%) or exceeded (22.6%) patients’ expectations (Table S4, Additional File 3). Patients largely agreed they received the right amount of information (86.2%), that this information was important to them (84.4%), and that the workbook was easy to understand (80%). Half (56.8%) would also recommend the workbook to others, but approximately one third (32.4%) were unsure.
Conversations were anticipated to take maximally 60 min. GPs reported 29/31 (93.5%) of first conversations and 100% of second conversations lasted up to 60 min. Documentation was primarily done in the electronic medical record (EMR): at T1, GPs reported that 27/30 (90%) of first conversations and 16/21 (76.2%) of second conversations were documented in the EMR (Table S5, Additional File 3).
Experiences with implementation
In interviews, most GPs expressed being satisfied with the training. GPs appreciated that the online format eliminated the need for physical transit, found the live session content interesting, and valued hearing how other GPs conducted ACP (Quote GP4.1). GPs who felt the training did not meet expectations, expected a more intensive approach, e.g. with more interaction between GPs than they felt the online format allowed, more exercises including demonstrations by the trainer, and practical guidance such as how to keep ACP conversations on track (Quote GP4.2).
GPs described the patient workbook as a helpful tool (Quote GP4.3) and spontaneously compared it to ADs, which they saw as off-putting to patients. Some GPs used the workbook to structure the conversation or filled it in together with the patient, and found it useful to ensure less of the conversation was forgotten. One GP however felt that the workbook may have been too difficult for some patients to use without guidance.
A lack of time could be a challenge to practical preparations for ACP conversations. Some GPs scheduled conversations during their free time instead of during consultation hours (Quote GP4.4). GPs also emphasized the importance of communication skills, a lack of which made conversations more challenging. They did not want to frighten or offend patients (Quote GP4.5). GPs felt it was a benefit that patients would know what to expect from the conversation; this contributed to how GPs anticipated the interaction with the patients would proceed (Quote GP4.6). GPs expressed that conversations were highly individualized. For example, some patients used the workbook intensively in preparation, but others did not. During appointments, GPs encountered barriers to having in-depth conversations when patients showed a “black or white” view of ACP or did not fully understand the topics. Themes discussed during the ACP conversations varied from patient to patient and GPs adjusted their approach accordingly (Quote GP4.7).
Patients were satisfied with the workbook, but at the moment of interviews with the researchers some had difficulty recalling detailed contents, or had misplaced it. They appreciated that the workbook questions were more general than ADs and valued that it encouraged reflection about living well (Quote PT4.1). Perceived and desired control in decision-making as part of ACP differed between patients. Some felt it was their right and responsibility to talk about their wishes and make decisions themselves. Others relinquished control, e.g. by trusting doctors to make the right decisions. Last, some patients were uncertain if they had control in making decisions about their care or treatment. They questioned to which extent ACP discussions would affect the care they received, or considered themselves laypersons who lacked the knowledge to make decisions about treatment (Quote PT4.2).
Prior patient experiences with ACP may have played a role during implementation. Some patients had already talked about ACP with their GP or had completed ADs (Quote PT4.3). This made ACP easier to talk about or revisit. A prior relationship with the GP was an important facilitator to conversations. For most patients, the GP was a trusted person with whom the patient had a longstanding, positive relationship, creating a secure setting to discuss ACP. Other patients placed more trust in specialist care providers, or did not know the GP well prior to the intervention, which could make conversations more difficult (Quote PT4.4). Patient experiences with the conversations described a feeling of reciprocal openness and equal participation during conversations, which facilitated patient comfort and satisfaction (Quote PT4.5). When a surrogate decision maker (SDM) was present during the conversation, patients experienced this as positive. Some SDMs were already involved in care for the patient and could provide support during conversations. In other cases, the SDM was able to ask questions alongside the patient (Quote PT4.6).
Maintenance (Intention to sustain the intervention over time)
Of GP respondents, two-thirds (66.7%) indicated high interest in using the intervention materials (workbook, conversation guide, conversation flowchart) in the future (Table S3, Additional File 3). Half of patient questionnaire responses (52.8%) indicated high interest in using the workbook in the future; more than one-quarter (27.8%) indicated low interest (Table S4, Additional File 3).
Perceived factors affecting intention for Maintenance, and participant recommendations for the future
Some GPs who were interviewed saw potential for sustainable implementation of the training through inclusion in bachelor- or master-level coursework, but also as a refresher for GPs with several years of experience. However, the latter may only draw GPs who already are interested in ACP (Quote GP5.1). Suggestions for the best format and session length for the future depended on preference and learning styles: some GPs preferred fully online modules to review on their own time, without attending live sessions, while others suggested also discussing the theoretical background live. GPs were also interested in continuing to use the workbook in practice; they discussed it with colleagues or created copies for future use. GPs saw it as a helpful tool for patients who signaled wanting to discuss ACP during regular consultations (Quote GP5.2).
GPs foresaw challenges to integrating conversations into future practice. Some were concerned that, while they made time for ACP conversations during the study, they would not be able to continue planning and conducting ACP efficiently within their limited consultation time per patient (Quote GP5.3). Some GPs suggested it would be more feasible to discuss ACP over a longer period of time, addressing smaller “chunks” per consultation. Regarding potential future implementation within an interprofessional team, task delegation in group practices and community health centers was proposed as a supporting factor to maintenance, but each GP would probably still do these conversations with the patients they saw regularly (Quote GP5.4). At the system level, unaddressed needs included a unified system for documenting ACP, for which the current EMR lacked a designated section, leading to discrepancies in how and where documentation is recorded (Quote GP5.5).
Patients differed in their intention to engage with ACP in the future. Some saw ACP as “finished” or wanted to let the topic rest after their conversations with the GP, without specifying when they might return to it. Others said they continued to engage with ACP after the study: through contemplation, talking to loved ones, and planning to talk to their GP (Quote PT5.1). Some patients were also in contact with other health providers and contemplated discussing ACP with them, but worried about demanding too much of their time (Quote PT5.2). When asked when might be a good time to revisit ACP, patients indicated this depended on changes in health and perceived quality of life (Quote PT5.3). To improve the intervention, some patients suggested wanting an addition of community-level support which normalizes ACP, such as media messaging which emphasizes that ACP is also relevant for people who are not terminally ill (Quote PT5.4).
Discussion
Main findings
We aimed to better understand the implementation of the complex ACP-GP intervention by assessing how the intervention was delivered and how it was experienced by both GPs and patients. We wanted to gain insight into what worked well and what could be improved for a sustainable implementation in general practice. Therefore, we conducted a mixed-methods process evaluation based on the RE-AIM framework.
We found that GP reach to participate in the study was low. We encountered low recruitment, similar to studies recruiting GPs to dementia care and palliative care research [33, 34]. Effectiveness of the intervention for the primary outcome was low, as it did not improve patient ACP engagement or GP ACP self-efficacy more than control [22]. In interviews, participants described other impacts of the intervention, discussed below. Adoption of the intervention components was variable and GP barriers to adoption overlapped with barriers to recruitment. Adoption of the documentation template was low. Due to this low adoption, the implementation domain of fidelity to the full intervention, as described in the protocol, was also low. GPs reported greater fidelity to the prespecified two conversations at T1 than patients. Patients reported especially high satisfaction with the ACP conversations. The intention for maintenance was moderate among GPs and patients.
Interpretation of main findings
What might explain findings concerning primary intervention outcomes?
The process evaluation offers possible explanations for why no significant differences were found between intervention and control on the primary outcomes of GP ACP self-efficacy, and patient ACP engagement.
Some GPs explained during interviews that they already felt confident to have ACP conversations before the intervention, due to prior practice experience. These GPs may represent participants who were already engaged and motivated for ACP [35]. Other GPs stated they would need more time to practice and build their confidence. Learning by following courses and exchanging experiences with peers may be one way to improve skills, but gaining experience by conducting ACP in daily practice is an equally important strategy [36]. This, however, may require more time than the three-month follow-up from baseline at which we measured our primary outcome [37], and may be hindered by remaining uncertainties about how to incorporate ACP conversations efficiently into daily practice.
During interviews with patients, we found that patients differed in attitudes towards ACP, and in their desire to be involved in decision-making about their health. Prior literature also suggests that patients may prefer to wait until they feel that ACP is clinically relevant [38, 39], even in cases where current health is poor [39]. Similarly, some patients interviewed for this process evaluation did not assess ACP as relevant at the moment, despite some also being supportive of the concept in general. This may affect “readiness” for talking about/documenting wishes for medical care at the end of life, a domain of the primary patient outcome of our trial (ACP engagement). Thus, attention should be paid to conveying the relevance and usefulness of ACP to all adults, such as from a perspective of holistic care in illness [39, 40]. In the ACP-GP workbook, we included vignettes to show how ACP can apply in many health states, but more directly-engaging preparatory work may be needed to bring this message to patients. A patient and public involvement (PPI) approach [41], e.g. through experience-based co-design [42], from the start of intervention development might have identified ways to more closely match the intervention to patients’ needs and barriers as they relate to ACP engagement.
What is the value of the intervention as perceived by GPs and patients?
Our primary outcomes were process-oriented, following theoretical frameworks of behavior change [20, 21, 43]. During interviews, we also asked GPs and patients to describe how they experienced the impact of the intervention. Some described a perceived impact similar to items in the questionnaires, such as patients thinking more about their wishes for future care, and GPs feeling capable to speak up for these wishes on the patient’s behalf. However, GPs and patients also described how engaging in conversations engendered feelings of trust and peace of mind, where patients felt reassured that their GP knew and supported their wishes. This impact aligns with important but under-researched outcomes of ACP within the domain of social, relational, and emotional aspects [37, 44, 45], but was not captured by the questionnaire.
For GPs, a recurring theme in interviews was that the intervention offered a more positive framing of ACP, which includes conversations about what “living well” means to the patient. Compared to AD-driven conversations and AD booklets, which they felt were off-putting to patients, this approach felt more fulfilling to GPs and made ACP easier to bring up proactively. It is possible that centering conversations around how best to maintain patient quality of life, mitigated known GP barriers related to fear of depriving patients of hope [14].
Implications for practice, policy, and research
Despite satisfaction with the intervention and perceived positive impacts by GPs and patients, implementing the intervention may be challenging due to remaining barriers. A lack of time was a significant barrier to reach, adoption, implementation, and potential maintenance. Given limited available time per consultation, GPs were uncertain how to continue “making time” for ACP. This clinician barrier to ACP is frequently reported [46,47,48,49,50] and prompts reflection about how to implement this intervention, and similar interventions, in practice. Sustainably incorporating the intervention into the GP workflow may require broadening the positive framing introduced by ACP-GP, which was widely appreciated and facilitated conversations, to an approach that takes place over the patient’s life course [51].
The low recruitment of GPs prompts considering to which extent ACP-GP might reach GPs outside a trial setting. In Belgium, ACP is promoted to GPs through modalities including (online) courses about ADs [52], training sessions to local peer-review groups [53], and recently a public health initiative with a website, posters, and flyers [54]. Incorporating components of ACP-GP within these initiatives may improve reach and (sustainable) implementation, such as by offering options to match the diverse preferences for avenues and modalities of the training expressed by GPs during this study. Integrating a quality-of-life-oriented approach in a live training session, can supplement judicial information which is now freely available through the practitioner-facing module of the public health campaign website. This could address GPs’ desire for more hands-on exercise while limiting time investment. Possibilities also include wider distribution of the workbook, which GPs saw as a useful tool for their practice. Being able to use the workbook to spontaneously offer information about ACP to patients who express interest or need, would allow GPs to act when ACP is perceived as most relevant, or to explain the relevance of ACP with the workbook as a supportive tool. This potentially addresses in-practice the barriers related to patients’ perceived relevance of ACP, as described above.
Recent literature emphasizes a holistic approach to ACP involving patients, surrogates, the community, clinicians, health systems, and policy [55]. Situating GPs within this holistic approach can support them in their task of ensuring information transfer with other care providers, who also can be involved in discussing ACP with patients. At the intra-practice level, GPs in group settings interviewed for this process evaluation were open to sharing some ACP tasks, while continuing to leverage the positive impact of their own longitudinal relationship with their own patients. In a Belgian survey study, one third of GPs reported being supported by a practice nurse. Most GPs agreed this collaboration positively impacted GP workload, and that nurses are suitable for providing patient education and health promotion advice [56]. This may offer new avenues for approaching ACP in this setting in the future and contribute to reducing barriers related to a lack of time by streamlining the process. It is, however, essential that the division of responsibilities is clear, and that there is continuity between clinicians [36]. This relates to reflections made by GPs about system-level barriers. GPs considered communication technology essential to facilitating (multidisciplinary) collaboration and follow-up of patients, but their unmet needs at this level were not addressed by offering a documentation template. International literature similarly suggests that documentation systems are not designed to optimize entry of ACP information [15], so standardization and ease of access directly within the EMR [57] should be prioritized [58].
Within the context of divisions of responsibilities for ACP in this holistic view, building patient awareness to ensure timely initiation may also require upstreaming conversations from a medicalized context to the community [59]. Presentations and workshops, media messaging, and sharing experiences with peers may promote awareness of ACP and empower patients to have meaningful conversations about living well, outside of a clinical setting. This can create a foundation for conversations with clinicians, who can support patients in making care goals concrete [60].
Strengths and limitations
A strength of this process evaluation is its use of RE-AIM, an intuitive and understandable established framework that can address questions beyond quantitative findings of primary effectiveness [28]. A mixed-method design using quantitative questionnaire data, and qualitative data from interviews, helped us understand how and why results occurred [29]. Analyzing GP and patient perspectives allowed us to find interacting notions of impact, and assess how GPs and patients evaluated the intervention. It also lets us identify barriers and facilitators at multiple levels, upholding the complexity approach which informed the development of the intervention.
The study also has limitations. Qualitative data were only collected from the intervention group, so potential factors leading to observed changes in outcomes in the control group are underexplored. We have reflected on a possible Hawthorne effect or increased awareness as a result of study procedures in the primary outcome report; asking control patients how their awareness changed or what other experiences they have had with ACP may have been informative in this regard. Some GPs reported selection bias towards patients with whom they felt comfortable discussing ACP. Additionally, a social desirability bias may affect responses, such as self-reported satisfaction, or during interviews. GPs who dropped out at T1 cited a lack of time to continue. One additional GP was not interviewed for the same reason, but was retained to data collection via questionnaires. An ‘exit interview’ with the GPs who dropped out may have added nuance to the findings. However, we also were able to interview GPs who were retained to data collection but did not have conversations with (all of) their patients. Regarding the RE-AIM domains, data collected during focus groups and interviews focused on the individual level, and questions mainly invited individual perspectives. Additionally, the maintenance domain was based on hypothetical responses, based on current experiences with the intervention. Nevertheless, some reflections about domains such as maintenance also hold implications for broader and longer-term setting-level possibilities, such as the place for ACP training within (continuing) medical education. Finally, recruitment of participants for this study was limited to the Flanders and Brussels regions of Belgium. In Belgium, solo GP practices are still the most frequently-occurring forms of practice. Generalizability of our findings to other regions and countries, such as those working primarily with group clinic settings, may thus be limited.
Conclusions
Implementing the complex ACP-GP intervention in general practice is feasible, and can be successful. When GPs are able to make time for ACP conversations and conduct these using a positive, rather than AD-driven approach, these conversations can be fulfilling and engender feelings of trust and peace of mind. However, the implementation process is challenging and the sustainability is suboptimal. Our findings will guide future research and recommendations for facilitating and implementing ACP in general practice.
Data availability
The data analyzed for the current study are available from the corresponding author on reasonable request.
Abbreviations
- ACP:
-
Advance care planning
- AD:
-
Advance directive
- MRC:
-
Medical Research Council
- RE-AIM:
-
Reach, Efficacy/Effectiveness, Adoption, Implementation, Maintenance
- SDM:
-
Surrogate decision maker
References
Sudore RL, Lum HD, You JJ, et al. Defining advance care planning for adults: a consensus definition from a multidisciplinary Delphi panel. J Pain Symptom Manage. 2017;53(5):821–e8321. https://doi.org/10.1016/j.jpainsymman.2016.12.331
Rosa WE, Izumi S, Sullivan DR, et al. Advance care planning in serious illness: a narrative review. J Pain Symptom Manage. 2023;65(1):e63–78. https://doi.org/10.1016/j.jpainsymman.2022.08.012
Grant MS, Back AL, Dettmar NS. Public perceptions of advance care planning, palliative care, and hospice: a scoping review. J Palliat Med. 2021;24(1):46–52. https://doi.org/10.1089/jpm.2020.0111
Macpherson A, Walshe C, Vyas A, O’donnell V. The views of patients with severe chronic obstructive pulmonary disease on advance care planning: a qualitative study. Palliat Med. 2013;27(3):265–72. https://doi.org/10.1177/0269216312440606
Waller A, Turon H, Bryant J, Zucca A, Evans T-J, Sanson-Fisher R. Medical oncology outpatients’ preferences and experiences with advanced care planning: a cross-sectional study. BMC Cancer. 2019;19(1):63. https://doi.org/10.1186/s12885-019-5272-6
Toguri JT, Grant-Nunn L, Urquhart R. Views of advanced cancer patients, families, and oncologists on initiating and engaging in advance care planning: a qualitative study. BMC Palliat Care. 2020;19(1):150. https://doi.org/10.1186/s12904-020-00655-5
Meeussen K, Van den Block L, Echteld M, et al. Advance care planning in Belgium and the Netherlands: a nationwide retrospective study via sentinel networks of general practitioners. J Pain Symptom Manage. 2011;42(4):565–77. https://doi.org/10.1016/j.jpainsymman.2011.01.011
Howard M, Bernard C, Klein D, et al. Older patient engagement in advance care planning in Canadian primary care practices results of a multisite survey. Can Fam Physician. 2018;64(5):371–7.
Musa I, Seymour J, Narayanasamy MJ, Wada T, Conroy S. A survey of older peoples’ attitudes towards advance care planning. Age Ageing. 2015;44(3):371–6. https://doi.org/10.1093/ageing/afv041
Alli A, Thorsteinsdottir B, Carey EC, Havyer RD. Never waste a pandemic: strategies to increase advance care planning now. Mayo Clin Proc Innov Qual Outcomes. 2021;5(5):946–50. https://doi.org/10.1016/j.mayocpiqo.2021.08.001
Scott IA, Mitchell GK, Reymond EJ, Daly MP. Difficult but necessary conversations-the case for advance care planning. Med J Aust. 2013;199(10):662–6. https://doi.org/10.5694/mja13.10158
Michiels E, Deschepper R, Van Der Kelen G, et al. The role of general practitioners in continuity of care at the end of life: a qualitative study of terminally ill patients and their next of kin. Palliat Med. 2007;21(5):409–15. https://doi.org/10.1177/0269216307078503
Howard M, Bernard C, Klein D, et al. Barriers to and enablers of advance care planning with patients in primary care: survey of health care providers. Can Fam Physician. 2018;64(4):e190–8.
De Vleminck A, Houttekier D, Pardon K, et al. Barriers and facilitators for general practitioners to engage in advance care planning: a systematic review. Scand J Prim Health Care. 2013;31(4):215–26. https://doi.org/10.3109/02813432.2013.854590
Lakin JR, Block SD, Billings JA, et al. Improving communication about serious illness in primary care: a review. JAMA Intern Med. 2016;176(9):1380–7. https://doi.org/10.1001/jamainternmed.2016.3212
Wichmann AB, van Dam H, Thoonsen B, Boer TA, Engels Y, Groenewoud AS. Advance care planning conversations with palliative patients: looking through the GP’s eyes. BMC Fam Pract. 2018;19(1):184. https://doi.org/10.1186/s12875-018-0868-5
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new medical research council guidance. Int J Nurs Stud. 2013;50(5):587–92. https://doi.org/10.1016/j.ijnurstu.2012.09.010
De Vleminck A, Houttekier D, Deliens L, Vander Stichele R, Pardon K. Development of a complex intervention to support the initiation of advance care planning by general practitioners in patients at risk of deteriorating or dying: a phase 0–1 study. BMC Palliat Care. 2016;15(1):17. https://doi.org/10.1186/s12904-016-0091-x
Dierickx S, Pardon K, Pype P, et al. Advance care planning, general practitioners and patients: a phase II cluster-randomised controlled trial in chronic life-limiting illness. BMJ Support Palliat. 2020:bmjspcare-2020-002712. https://doi.org/10.1136/bmjspcare-2020-002712
Sudore RL, Heyland DK, Barnes DE, et al. Measuring advance care planning: optimizing the advance care planning engagement survey. J Pain Symptom Manage. 2017;53(4):669–e6818. https://doi.org/10.1016/j.jpainsymman.2016.10.367
Baughman KR, Ludwick R, Fischbein R, et al. Development of a scale to assess physician advance care planning self-efficacy. Am J Hosp Palliat Med. 2017;34(5):435–41. https://doi.org/10.1177/1049909115625612
Stevens J, Miranda R, Pype P et al. Complex advance care planning intervention in general practice (ACP-GP): cluster-randomised controlled trial. Br J Gen Pract. 2023:BJGP.2023.0022. https://doi.org/10.3399/BJGP.2023.0022
Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14(1):15. https://doi.org/10.1186/1745-6215-14-15
Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Team RS. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413 LP – 416.https://doi.org/10.1136/bmj.332.7538.413
Skivington K, Matthews L, Simpson SA et al. A new framework for developing and evaluating complex interventions: update of medical research council guidance. BMJ. 2021;374(2018):n2061. https://doi.org/10.1136/bmj.n2061
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7. https://www.ncbi.nlm.nih.gov/pubmed/10474547
Glasgow RE, Harden SM, Gaglio B, et al. RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review. Front Public Heal. 2019;7. https://doi.org/10.3389/fpubh.2019.00064. https://www.frontiersin.org/articles/
Glasgow RE, Estabrooks PE. Pragmatic applications of RE-AIM for health care initiatives in community and clinical settings. Prev Chronic Dis. 2018;15:E02. https://doi.org/10.5888/pcd15.170271
Holtrop JS, Rabin BA, Glasgow RE. Qualitative approaches to use of the RE-AIM framework: rationale and methods. BMC Health Serv Res. 2018;18(1):177. https://doi.org/10.1186/s12913-018-2938-8
Creswell JW, Clark VLP. Designing and conducting mixed methods research. Third Edit. Los Angeles: SAGE; 2017.
Stevens J, Pype P, Eecloo K, Deliens L, Pardon K, De Vleminck A. Facilitating advance care planning in the general practice setting for patients with a chronic, life-limiting illness: protocol for a phase-III cluster-randomized controlled trial and process evaluation of the ACP-GP intervention. BMC Palliat Care. 2021;20(1):97. https://doi.org/10.1186/s12904-021-00796-1
Scherrens AL, Cohen J, Mahieu A, Deliens L, Deforche B, Beernaert K. The perception of people with cancer of starting a conversation about palliative care: a qualitative interview study. Eur J Cancer Care (Engl). 2020;29(5):1–14. https://doi.org/10.1111/ecc.13282
Leysen B, Van den Eynden B, Janssens A, Wens J. Recruiting general practitioners for palliative care research in primary care: real-life barriers explained. BMC Fam Pract. 2019;20(1):40. https://doi.org/10.1186/s12875-019-0930-y
Lech S, O’Sullivan JL, Wellmann L, et al. Recruiting general practitioners and patients with dementia into a cluster randomised controlled trial: strategies, barriers and facilitators. BMC Med Res Methodol. 2021;21(1):61. https://doi.org/10.1186/s12874-021-01253-6
Howard M, Langevin J, Bernard C, et al. Primary care clinicians’ confidence, willingness participation and perceptions of roles in advance care planning discussions with patients: a multi-site survey. Fam Pract. 2020;37(2):219–26. https://doi.org/10.1093/fampra/cmz050
Glaudemans JJ, de Jong AE, Onwuteaka Philipsen BD, Wind J, Willems DL. How do Dutch primary care providers overcome barriers to advance care planning with older people? A qualitative study. Fam Pract. 2018;36(2):219–24. https://doi.org/10.1093/fampra/cmy055
Pivodic L, Wendrich-van Dael A, Gilissen J, et al. Effects of a theory-based advance care planning intervention for nursing homes: a cluster randomized controlled trial. Palliat Med. 2022;36(7):1059–71. https://doi.org/10.1177/02692163221102000
Hall A, Rowland C, Grande G. How should end-of-life advance care planning discussions be implemented according to patients and informal carers? A qualitative review of reviews. J Pain Symptom Manage. 2019;58(2):311–35. https://doi.org/10.1016/j.jpainsymman.2019.04.013
Simon J, Porterfield P, Bouchal SR, Heyland D. Not yet and just ask: barriers and facilitators to advance care planning-a qualitative descriptive study of the perspectives of seriously ill, older patients and their families. BMJ Support Palliat Care. 2015;5(1):54–62. https://doi.org/10.1136/bmjspcare-2013-000487
Hutchison LA, Raffin-Bouchal DS, Syme CA, Biondo PD, Simon JE. Readiness to participate in advance care planning: a qualitative study of renal failure patients, families and healthcare providers. Chronic Illn. 2017;13(3):171–87. https://doi.org/10.1177/1742395316675023
Turk A, Boylan AM, Locock L. A researcher’s guide to patient and public involvement; 2017. https://oxfordbrc.nihr.ac.uk/wp-content/uploads/2017/03/A-Researchers-Guide-to-PPI.pdf
Bielinska AM, Archer S, Darzi A, Urch C. Co-designing an intervention to increase uptake of advance care planning in later life following emergency hospitalisation: a research protocol using accelerated experience-based co-design (AEBCD) and the behaviour change wheel (BCW). BMJ Open. 2022;12(5). https://doi.org/10.1136/bmjopen-2021-055347
Fried TR, Redding CA, Robbins ML, et al. Stages of change for the component behaviors of advance care planning terri. J Am Geriatr Soc. 2010;58(12):2329–36. https://doi.org/10.1111/j.1532-5415.2010.03184.x.Stages
De Vleminck A, Van den Block L. How to enhance advance care planning research? Palliat Med. 2023;37(5):660–2. https://doi.org/10.1177/02692163231170658
Gilissen J, Van den Block L, Pivodic L. Complexities and outcomes of advance care planning. JAMA Intern Med. 2021;181(1):142–3. https://doi.org/10.1001/jamainternmed.2020.5539
Blackwood DH, Walker D, Mythen MG, Taylor RM, Vindrola-Padros C. Barriers to advance care planning with patients as perceived by nurses and other healthcare professionals: a systematic review. J Clin Nurs. 2019;28(23–24):4276–97. https://doi.org/10.1111/jocn.15049
Bernard C, Tan A, Slaven M, Elston D, Heyland DK, Howard M. Exploring patient-reported barriers to advance care planning in family practice. BMC Fam Pract. 2020;21(1):94. https://doi.org/10.1186/s12875-020-01167-0
Malhotra C, Chaudhry I. Barriers to advance care planning among patients with advanced serious illnesses: a national survey of health-care professionals in Singapore. Palliat Support Care. 2023:1–8. https://doi.org/10.1017/S1478951523000214
Meehan E, Foley T, Kelly C, et al. Advance care planning for individuals with chronic obstructive pulmonary disease: a scoping review of the literature. J Pain Symptom Manage. 2020;59(6):1344–61. https://doi.org/10.1016/j.jpainsymman.2019.12.010
Tilburgs B, Vernooij-Dassen M, Koopmans R, Weidema M, Perry M, Engels Y. The importance of trust-based relations and a holistic approach in advance care planning with people with dementia in primary care: a qualitative study. BMC Geriatr. 2018;18(1):184. https://doi.org/10.1186/s12877-018-0872-6
Hickman SE, Lum HD, Walling AM, Savoy A, Sudore RL. The care planning umbrella: the evolution of advance care planning. J Am Geriatr Soc. 2023;71(7):2350–6. https://doi.org/10.1111/jgs.18287
LevensEinde InformatieForum. Vorming aangaande Voorafgaande zorgplanning - VZP. https://leif.be/opleidingen/opleiding-aangaande-voorafgaande-zorgplanning/
Domus Medica. Vroegtijdige zorgplanning. https://www.domusmedica.be/vorming/vorming-voor-lokale-kwaliteitsgroepen/vroegtijdige-zorgplanning. Published 2018.
FOD Volksgezondheid Veiligheid van de Voedselketen en Leefmilieu. Praat over je oude dag. https://www.health.belgium.be/nl/news/praat-over-je-oude-dag. Published 2021.
McMahan RD, Tellez I, Sudore RL. Deconstructing the complexities of advance care planning outcomes: what do we know and where do we go? A scoping review. J Am Geriatr Soc. 2021;69(1):234–44. https://doi.org/10.1111/jgs.16801
Matthys E, Remmen R, Van Bogaert P. Practice nurse support and task suitability in a general practice: a cross-sectional survey in Belgium. J Interprof Care. 2019;33(6):661–9. https://doi.org/10.1080/13561820.2019.1569602
Huber MT, Highland JD, Krishnamoorthi VR, Tang JW-Y. Utilizing the electronic health record to improve advance care planning: a systematic review. Am J Hosp Palliat Med. 2017;35(3):532–41. https://doi.org/10.1177/1049909117715217
Dupont C, De Vleminck A, Deliens L, Gilissen J. Advance care planning in Belgium. Z Evid Fortbild Qual Gesundhwes. 2023. https://doi.org/10.1016/j.zefq.2023.05.003
Prince-Paul M, DiFranco E. Upstreaming and normalizing advance care planning conversations-A public health approach. Behav Sci (Basel). 2017;7(2). https://doi.org/10.3390/bs7020018
Gazarian P, Gupta A, Reich A, et al. Educational resources and self-management support to engage patients in advance care planning: an interpretation of current practice in the US. Am J Hosp Palliat Med. 2022;39(8):934–44. https://doi.org/10.1177/10499091211064834
Acknowledgements
The authors sincerely thank all GPs and patients who participated in the trial and process evaluation study. We thank Kim Eecloo, MSc (Universiteit Gent), Aurelie Joos, MSc (Universiteit Gent), Christine Vanmeenen (Consumenten Contact), and Lara Craenen, MSc, for their support with data collection.
Funding
This work was supported by a predoctoral scholarship and project funding from Research Foundation - Flanders (Belgium) (Fonds Wetenschappelijk Onderzoek, FWO) (registration number 11B6220N and registration number G061118N respectively). ADV is supported by an FWO postdoctoral grant (registration number 12ZY222N). The funder has no role in the conception of the study design; in the collection, management, analysis and interpretation of data; in the writing of the manuscript; or in the decision to submit the manuscript for publication.
Author information
Authors and Affiliations
Contributions
J.S., L.D., P.P., A.DV., and K.P. conceptualized the study. J.S. and A.DV. collected data. Data were analyzed and interpreted by J.S., A-L.S., K.P., and A.DV. The main manuscript text, tables, and figures were drafted by J.S. All authors provided critical revisions to the manuscript and approved the final version for submission.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The study was performed in accordance with all relevant guidelines and regulations. The study was approved by the medical ethics committee of the Brussels University Hospital (ref: 2020/068). All participants provided written informed consent to participate in the randomized controlled trial, including the process evaluation. Informed consent was also given specifically to the researchers to contact participants for interviews. Permission to record was confirmed verbally with all participants at the time of the interviews.
Consent for publication
N/A.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
12875_2024_2510_MOESM1_ESM.docx
Supplementary Material 1: Components of the complex ACP-GP intervention. Description: A description of the four components of the intervention
12875_2024_2510_MOESM2_ESM.docx
Supplementary Material 2: Topic lists for focus groups and interviews. Description: Instructions and structure for semi-structured focus groups with GPs (also used for individual interviews with GPs), and individual interviews with patients. Translated from Dutch to English.
12875_2024_2510_MOESM3_ESM.docx
Supplementary Material 3: Additional tables for the results section. Description: Tables with additional information for the results section. Characteristics of interviewed participants, baseline characteristics of GPs and patients recruited to the cluster-randomized controlled trial, in the intervention and control group, satisfaction, and characteristics of intervention conversations (from satisfaction questionnaire)
12875_2024_2510_MOESM4_ESM.docx
Supplementary Material 4: CONSORT flowchart of recruitment and retention. CONSORT flowchart showing the flow of recruitment and retention to the cluster-randomized controlled trial
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Stevens, J., Scherrens, AL., Pype, P. et al. Experiences with implementing advance care planning (ACP-GP) in Belgian general practice in the context of a cluster RCT: a process evaluation using the RE-AIM framework. BMC Prim. Care 25, 247 (2024). https://doi.org/10.1186/s12875-024-02510-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12875-024-02510-5