Abstract
Background
The ESCALATION system is a novel paediatric Early Warning System that incorporates family involvement and sepsis recognition. This study aimed to assess the feasibility and iteratively refine the ESCALATION system in a variety of hospital settings in preparation for full-service implementation.
Methods
A series of four multi-methods studies using an Implementation Science and co-design approach were conducted. We examined concepts of implementation, context, and mechanisms of action across a variety of hospitals. Data collected included practice and chart audits, surveys (health professionals), interviews (families) and focus groups (health professionals). Quantitative data were analysed descriptively with qualitative findings assessed by content analysis or thematic analysis.
Results
There were 650 audits (Study I–IV), 205 health professional survey responses (Study I), 154 health professionals participated in focus groups (Study II–IV), 13 parents of hospitalised children interviewed (Study I), and 107 parents reported their involvement in the ESCALATION system (Study III–IV). Each of the studies further refined and confirmed the feasibility, specifically the components of family involvement and the sepsis recognition pathway.
Conclusion
The Implementation Science evaluation of the ESCALATION system resulted in a uniform approach that was feasible and acceptable to users and appropriate for full-service implementation.
Impact
-
This series of four studies used a co-production approach built on the Medical Research Council framework to understand feasibility and acceptability of an intervention to improve recognition and response to clinical deterioration in children to the point of full-service implementation.
-
We have reported a detailed, systematic approach to assessing feasibility and acceptability of a complex intervention using established methodologies for whole of health system implementation.
-
The ESCALATION System is an evidence based paediatric early warning system that is a highly refined, well accepted and accommodates a health system that has substantial contextual variation.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Introduction
Delays in recognition and response to clinical deterioration are causes of sub-optimal care for hospitalised children. Early Warning Systems (EWS) have been widely implemented in hospitals to promote timely detection of changes in a child’s condition that may forewarn of clinical deterioration.1 Early Warning System components include observation and response charts featuring graphical information to track trends of vital signs, specified thresholds indicating increasing variance from acceptable ranges to trigger an escalation of care response, and escalation of care pathways for increasing urgency of response.
Despite widespread use of EWS there continue to be systemic failures including delays to detect and address acute clinical deterioration. Recent high-profile hospital incidents2,3 and coronial cases4,5,6,7,8 have noted serious adverse outcomes including death. Especially worrying in paediatric contexts are cases where families’ concerns about their child’s deteriorating health condition have gone unheard by health professionals and signs of clinical deterioration overlooked.6,8,9
EWS are complex interventions,10 in that they involve several interacting components, target a range of desired behaviours, require effective interactions between professional groups with specific expertise and skills across multiple healthcare settings with a variability of possible outcomes.11 Family activated escalation of care processes for clinical deterioration largely remain separate to EWS. There have been many reported barriers to implementation and effective use of processes for family involvement in escalation of care including families’ low levels of awareness, lack of confidence to raise concerns, or reservations about challenging health professionals.12,13 Health professionals’ beliefs and attitudes add additional complexity to family involvement in escalation of care.
The leading cause of unidentified deterioration preceding preventable childhood death and disability is sepsis.14 Approximately one third of sepsis deaths occur in previously healthy children and another third of survivors suffer long-term morbidity.14 Sepsis is preventable if detected and treated in a timely manner, yet delays in recognition and management of sepsis are common.8,14 International15 and Australian guidelines16,17 recommend use of tools for systematically screening for sepsis to promote early recognition, including identifying patients at risk of sepsis. Components missing from existing paediatric EWS are integrated family involvement and sepsis recognition pathways.
The ESCALATION system is an EWS designed for use with acutely unwell children in the largest state in Australia, covering an area of 2,529,875 square km, encompassing the entire western third of the country. Despite the immense size, it is one of the least densely populated states in the world, with a total population of 2.7 million most of which (92%), is concentrated in the south-west, with a large proportion of the state sparsely populated.18 The low population density, coupled with vast distances between healthcare facilities, creates unique challenges in healthcare delivery. The approach to assessing paediatric patients in Western Australia had been identified as inconsistent and inadequate.19 The ESCALATION system, developed specifically for the West Australian context, integrates both family involvement and sepsis recognition with escalation of care pathways developed to suit operational contexts, acknowledging complex interventions work best if tailored to local needs rather than being completely standardised.10
Best practice is to develop interventions systematically, with the ESCALATION development process being based on Hawkins et al.20 three-stage framework of (1) evidence review, stakeholder engagement and consultation, (2) co-production by researchers and stakeholders planning and developing the intervention, and (3) prototyping and testing the intervention.19 The resultant ESCALATION system incorporates a whole-system approach to early recognition of clinical deterioration and effective and timely escalation of care.19 The theoretical underpinning is key ESCALATION system components interact to support health professionals’ critical thinking and situational awareness to detect and respond to early signs of clinical deterioration.
Building on the initial ESCALATION system development,19 we report a series of studies based on an Implementation Science (IS) approach to examine the mechanisms of the intervention and how those mechanisms might influence or be influenced by the context.21 Our aim was to understand the feasibility of using the ESCALATION system in a variety of hospital settings and iteratively refine the system in preparation for state-wide service implementation.
Methods
The Medical Research Council (MRC) framework for developing and evaluating complex interventions describes five research phases that encompass; developing, piloting and feasibility, evaluating, reporting through to implementation.11 This series of multi-methods studies, spanning 2019–2022, used a co-production approach and draws on the MRC framework11 recommendations that emphasise the importance of adequate intervention piloting and feasibility work to fully consider practical issues prior to implementation. Findings from each study informed subsequent studies to increase transferability across settings to the final system for full-service implementation Fig. 1.
Adapted from Gill, FJ. et al.19 “Development of an evidence-based ESCALATION system for recognition and response to paediatric clinical deterioration.” Australian critical care 35(6): 668-676.
The feasibility of the intervention and logistics for delivery in specific settings were examined through close monitoring of activities performed and users’ capability of carrying out the components of the intervention as planned.22 Acceptability was assessed through users’ attitude towards the intervention. Feasibility and acceptability indicators are reported using process evaluation concepts of -:
-
implementation – what and how the intervention was delivered?
-
context -what influenced it (the intervention)?
-
mechanisms of impact – how does the delivered intervention produce change?23
The research co-production24 was a partnership between researchers and knowledge users enabled through a steering group of stakeholders (20 representatives from five health services, private hospitals, community health services, state pre-hospital emergency response service, state aeromedical emergency service, and two health consumers). Additionally, two health consumer advisory groups provided a family (seven members) and youth (six members) perspective throughout. Where focusing specifically on chart design, education, training and implementation, smaller groups of health professionals and consumers worked with the research team.19
Note as illustrated in Fig. 2 our series of studies involved six hospitals (A-F described in Table 1) and four versions of the ESCALATION system. In Study I (ESCALATION version 1.0) we examined System feasibility and acceptability across a range of settings. For Study II and Study III (ESCALATION versions 2.0–3.0), our focused assessments were System refinements in two different settings (regional hospital E and the children’s hospital A). In Study IV we further focused assessment at metropolitan hospital C to assess refinements and feasibility of version 4.0 ESCALATION pathway ensuring System readiness for implementation.
Implementation – what and how the intervention was delivered?
To understand intervention feasibility we examined and refined:
-
Bedside audits based on previously reported studies,25,26 tested for clarity with six ESCALATION charts (Online File: bedside audit study I). Audits were conducted after 8 weeks to examine the degree of fidelity (intervention delivered as intended) evident through recording of variables and early warning score, response and actions to escalate care. Each study audit results enabled provision of feedback to promote increased fidelity,
-
Implementation preparation that involved multiple education and training approaches, iteratively refined and improved (Table 2).
-
A dedicated website (www.escalation.com.au) supported communication and sharing of education resources.
-
Workshops attended by “Champions” who were educators and other key nurses who volunteered to be ESCALATION leads. Workshops consisted of instruction, demonstration, discussion, case studies, clinical simulation and sharing of previous study findings. The feedback enabled Champions to target education strategies.
-
Information packs, posters, pamphlets and fact sheets supported the Champions to provide health professional and family education at their own hospitals. Study 1 evaluation resulted in setting a minimum target of 80% of staff at all sites to receive education and training in preparation for Study II.
-
For Study II videos were developed and used at training sessions to provide instruction and demonstration using the ESCALATION System in simulated clinical scenarios. Further refinement in preparation for Study III involved developing an education package hosted on an online learning management platform. The videos and PowerPoint™ presentations were embedded in the package and covered key components including involving family in assessment documenting variables, calculating the early warning score, escalation of care pathways, communication using the ISOBARNOW framework. There was also a focus on raising awareness about sepsis, recognition of signs of sepsis, online links to family stories, health service policies as well as additional resources. Successful completion of the online package was assessed using a multichoice quiz. Prior to Study III, there was a focused effort on raising staff awareness about sepsis and the sepsis escalation pathway through local presentations and distribution of lanyards. Prior to Study IV the package was further refined with expert input and review followed by testing in a clinical simulation environment. The education package development and evaluation has been reported in greater detail elsewhere.27
-
Context – what influenced it (the intervention)?
Context covers anything external to the intervention that may act as a barrier or facilitator to implementation.23 The ESCALATION system19 was developed in an Australian state where unique healthcare challenges are faced due to geography, isolation, and sparse population,28 significant variations exist in healthcare services, including health professionals’ experience and expertise in caring for acutely unwell children.
For Study I the following data collection methods were used to assess feasibility, acceptability and identify contextual factors that may influence implementation:
-
Transfer audit captured the characteristics of patients transported from participating sites to the ED at the specialist children’s hospital and documented communication about patients’ clinical condition. Eligible cases were identified through the children’s hospital ED information system.
-
Escalation of care audit involved identifying patients with clinical deterioration whose care was escalated to urgency level of a Medical Emergency Review. This allowed examination of routinely collected data in the clinical deterioration context for patients unexpectedly transferred to higher level within a study site or to another hospital. Eligible cases were identified by the Champions and medical emergency response records.
-
Health Professionals Survey adapted from two existing Australian surveys26,29 to understand health professionals’ attitudes to the intervention. There were 30 items using 5-point Likert-type agreement scale responses, five dichotomous responses, and one open-ended question. The survey was pre-tested for clarity with four expert nurses, with minor wording changes made.
-
Champions feedback: Champions reported on feasibility and acceptability of education and training delivered, and reported any documented adverse events associated with the intervention.
Mechanisms of impact - how does the delivered intervention produce change?
Mechanisms of impact involves understanding how the intervention produces change and was examined through participants’ responses and interactions with the intervention in context.30 Data collection methods were designed to assess acceptability of the intervention by understanding users’ (doctors, nurses and parents) attitudes.22 For reporting purposes, the definition of “parent” was mother, father, guardian or whoever identified as primary caregiver. We collected the following data:
-
Health Professionals Focus groups31 were held in-person and online following completion of study periods. An adapted Claims, Concerns, Issues method26 was used to collaboratively explore; Claims by participants identifying what worked well?, Concerns by participants identifying what could be better?, Issues (solutions) were established by group consensus and action plans identified. Focus groups were conducted by FG (PhD), AC (Hons) and PF (Master), all Registered Nurses with experience conducting focus groups and interviews.
-
Parent interviews For Study I, a convenience sample of parents were recruited while their child was an inpatient or contacted by telephone post-discharge. A semi-structured interview guide was informed by the health consumer advisory groups. The interview guide was pre-tested with two parents who were not study participants. Interviews were conducted in-person or by telephone. Interviews were audio-recorded with participant permission.
-
For studies II–IV, to understand if the family involvement intervention component was delivered as intended, the bedside audit was expanded to include the following Parent questions (if a parent was present); “has your nurse asked you how you feel your child is doing?”, “has your nurse regularly included you in your child’s assessment?”, and “do you know about CARE Call?” (state-wide family escalation of care process).
Table 3 depicts indicators collected, noting the focus shift from initially being on improving and refining the intervention (Study I) to later more focused evaluation to promote implementation fidelity (Study IV).
Data analysis
Quantitative data were collated descriptively. Survey open-ended questions were analysed using summative content analysis.32 Focus group data were analysed in real-time by two female researchers (FG[RN, PhD], AC[RN, BN], or PF[RN, MN]) with participants to ensure all issues were confirmed and clarified. Issues were then prioritised and used to develop action plans. The contributions of all groups were collated, findings themed and shared with a selection of participants for verification.31 Parent interview data were collected and analysed iteratively so that themes identified in early interviews were explored in later interviews. A structured multi-step process for inductive interview thematic analysis33 was followed. A second research team member checked data coding. An audit trail of decisions was retained. The health consumer advisory groups provided feedback on findings. The mixed methods analysis included data integration of the quantitative and qualitative findings using joint displays34 as a structure combining the Claims, Concerns, Issues31 approach with the MRC framework23 concepts to understand what and how the intervention was delivered, contextual factors and mechanisms of impact. Our interpretation of the findings from multiple data sources was verified with the steering group.
Ethical approvals were obtained from Health Services RGS 3192 and 1940, University (HRE2019-6412) Human Research Ethics Committees and West Australian Aboriginal Health Ethics Committee (951). For reporting qualitative research the Consolidated Criteria for Reporting Qualitative Research reporting checklist was followed.35 For this article we reported on the implementation component of the Standards for Reporting Implementation Studies (StaRI) checklist.36
Results
Implementation – what and how the intervention was delivered
At participating sites, during the four studies, the ESCALATION system was used in place of existing paediatric EWS for all paediatric patients (age 0–16 years) who presented to the ED and or were admitted. For Hospital A (specialist paediatric hospital): Study I one ward, Study II two wards, Study III all inpatient areas; and for Hospitals B-E (hospitals with or without specialist paediatric services) ED and inpatient areas where paediatric patients were cared for (Table 4).
The bedside audits demonstrated chart documentation was used as intended; assessed by key safety indicators of correct chart for age range, recording date, time, clinical variables, calculated early warning score, escalation of care pathway utilised. Examining routinely collected data revealed a policy-practice gap for patient monitoring and documentation by nurses. For example, for Study I patient blood pressure at ED presentation or ward admission was recorded on 167 (67%) charts. Additionally, gaps were identified in nurses’ knowledge and skills related to clinical assessment during the training sessions. Following targeted education, audit and feedback, the frequency of documented blood pressure measurement increased over subsequent studies but remained the most common missing variable. During focus group discussions many nurses reported they did not routinely measure children’s blood pressure and requested further clarification about when measuring blood pressure was appropriate. Over the four studies, family or clinician concern was recorded for between 6 and 66% of charts. The high proportion of family or clinician concern captured in Study IV was explored and found to be related to misinterpretation of the variable by staff, and targeted education was provided. See supplementary file Bedside Audit Study 1.
All Champions attended workshops as planned. Study I evaluation showed the Champions were satisfied with the preparation received and resources. They did report being unable to reach all health professionals to provide education and training at their sites, particularly in ED. In Study 1 only 362 (30%) health professionals received education across the six sites reflecting it had not been feasible to deliver in-person training as planned. This was backed up by Study I staff survey responses and focus groups findings. As a result, we set and achieved a target of 80% of health professionals to receive education and training using multiple delivery approaches in preparation for Studies II–IV.
Context - what influenced it?
As previously described, six hospitals were purposively selected for Study 1 to enable assessment of feasibility across a range of settings reflecting a variety of health facilities and paediatric services, from the specialist children’s hospital to a small district hospital with no specialist paediatric service (Table 1).
Transfer audit
During Study I, 151 patients were transferred from participating sites to the specialist children’s hospital, with 141 patient health records available for review. Approximately 20% (30) patients were transferred for clinical deterioration. The audit showed the escalation process documentation provided a common language across sites.
Escalation of care audit
During Study I, the feasibility of the escalation of care process was assessed by examining health records of 11 patients identified as receiving a Medical Emergency Review. Six patients were successfully managed at their hospital. Five patients were subsequently transferred to the specialist children’s hospital. The audit showed the escalation process documentation provided a common language across sites.
Health professionals surveys
During Study I, surveys were used to collect feedback on attitudes towards the new system. Overall, there was strong agreement (81%) with the system design and features. The majority (68%) agreed the escalation pathway was appropriate for use at their hospital. Almost three quarters (71%) agreed the escalation pathway assisted them managing deteriorating patients. Some of the new system features initially received mixed responses. One half (50%) of participants agreed that the addition of a family concern variable assisted them to seek parents’ views about their child’s condition, 29% were neutral and 21% disagreed. Regarding the communication framework, 43% agreed the framework supported their escalation of care communication, while 30% were neutral and 22% disagreed. Disagree responses were related to lack of understanding by health professionals who had not received education and training.
Champions feedback
Champions reported no documented adverse patient safety events associated with the ESCALATION system use.
Mechanism of impact - how does the delivered intervention produce change?
Health Professionals focus groups
For Study I and Study II, the purpose was to understand the acceptability of intervention delivery in each context, any unintended effects and identify any refinements required (Table 4). Themes developed from the Claims, Concerns, Issues process were; ‘supporting assessment’, ‘chart design’ and ‘implementation’.
At Study I, health professionals were positive about many system features that supported clinical assessment, including the integrated family concern variable. Health professionals who had not received education were less certain about its value. Most reported they had not purposefully used the ISOBAR NOW communication framework. Several nurses requested more education about paediatric clinical assessment. Nurses who were unfamiliar with using a scoring system requested more education and practice opportunity, and more local Champion support. Action plans included education and training content to be refined and expanded to explicitly address identified knowledge gaps. Health Professionals were positive about the overall chart design, especially the structured ABCDE format. Some features during development that had been considered essential initially, such as space to write initials and document modifications, were later found to be redundant. Despite the chart being A3 size, there remained a concern about the small font size and small space available for documentation. Feedback about being prepared for implementation was mixed. Those who had received education felt well prepared, whilst those who had little or no education were less confident. See Supplementary File: Focus Groups Study I and II key findings.
For Study III and Study IV, the purpose of focus groups was to evaluate the preparation for using the ESCALATION System, acceptability of additional features of Version 3.0 that included sepsis recognition prompts and sepsis escalation of care pathway, and collaboratively address any remaining concerns to promote intervention fidelity (Table 3). Health professionals reported they felt well prepared for implementation, despite timing coinciding with COVID-19 pandemic related high clinical activity. Most had completed the online education package, although they reported a strong preference for in-person education. Some nurses reported the sepsis education content was new information they had not previously known. A small number of medical staff held reservations about not including the temperature variable in the early warning score, although others appreciated how it reduced unnecessary escalation of care for children with fever. Further clarification was still needed about documentation expectations. Most reported they had not purposefully used the ISOBAR NOW communication framework. For chart design and new features, all were supportive of the addition of the sepsis escalation pathway. Some reported anecdotally, since implementation of the ESCALATION system, they felt patient deterioration was being detected sooner. Action plans included practical solutions for more easily locating and using the chart at patient bedsides, and further targeted education with audit and feedback to monitor behaviour change. See Online File: Study III and IV Claims, Concerns, Issues.
Parent interviews
During Study 1, 13 interviews were conducted with a convenience sample of parents of children who were inpatients. Six of the children had experienced a clinical deterioration event during their hospital stay (Table 4). Two themes were developed. Theme 1 Parents reported ‘Being included in their child’s assessment’ and how being invited to contribute was empowering: “I just used to never say anything because I’d worry they’d just shrug you off … so you feel like you have a bit more say” (P10). Theme 2 ‘Family involvement posters supported communication of concerns’ about their child’s condition as “I found it a lot easier to describe what was going on” (P10). Key factors influencing parents’ involvement were how health professionals communicated with families (Table 5).
For both Study III and IV, based on the bedside audit results, over 85% of parents reported they had been asked for their opinion about their child’s condition and felt included in their child’s assessment. However, parent awareness about the family escalation of care processes remained low at 61% and 40% indicating a continuing need to raise awareness.
System refinements across Study 1 – Study IV
In-principle agreement had been reached to implement ESCALATION in all hospitals at the completion of Study I using Version 2.0. As the testing process evolved along with emerging evidence, it was agreed to add to the sepsis recognition prompts and include a sepsis escalation pathway into Version 3.0. It was also recognised that while the Version 3.0 escalation of care pathway was broadly supported, it would not fully meet the contextual needs of all users in terms of escalation of care responses available in settings other than the specialist children’s hospital. The process of revisions sequentially resulted in ESCALATION version 4.0 including one of three escalation pathways for; specialist children’s hospital, metropolitan hospitals, regional/rural hospitals. See Supplementary file. Version 4.0 PARROT chart age <3 months for Regional/Rural Hospitals. Further detail of the system refinements is presented in Table 6.
Discussion
The ESCALATION System was developed as a standardised evidence-based approach to facilitate early recognition and response to paediatric clinical deterioration. Encompassing integrated family involvement, sepsis recognition prompts and an escalation pathway with a supported communication framework, it is suitable for use in a variety of clinical settings. Whilst there was willingness by all stakeholders to adopt a uniform standardised paediatric EWS, for many health professionals, especially those unfamiliar with using scoring systems, adopting the ESCALATION system involved using a cognitively different approach to assessing clinical deterioration and necessitated greater change to existing behaviours.37
Implementation involves understanding and capturing whether the intervention was delivered as intended. Understanding adherence, and what was delivered in practice, helps distinguish between adaptions made to suit different contexts and changes made that may undermine implementation.22,23 Additionally, it is important to understand how the intervention was delivered to provide generalisable knowledge on how best to ultimately implement the strategy. Our focus was assessment of feasibility and acceptability to refine the intervention design23 and evaluate the education and training strategies for implementation.
Including the perspectives of diverse stakeholders and users (including health consumers with experience of being parents or patients in hospital) through meaningful engagement created the collaborative environment for iterative system refinements. For example, we had previously explored inclusion of a sepsis escalation pathway, but inclusion was not agreed to in earlier versions. As a result of ongoing stakeholder engagement, consensus was reached to include a sepsis escalation pathway in Version 3.0. This meant that when the ESCALATION system was fully implemented, it provided an integrated paediatric sepsis clinical support tool, coinciding with the release of the Australian Sepsis Clinical Care Standard requiring health services to use a clinical support mechanism to help recognise sepsis early and escalate care when required.17
The version for full implementation included tailoring of escalation pathway responses to match differently resourced hospital contexts. Our reflection accounting for the later version system changes was stakeholder buy-in and willingness to achieve a uniform approach was initially associated with temporary changes to health service policies and procedures managed during the research phases. The reality of full implementation required all hospitals and health services to undertake permanent policy and procedure changes. At a local level, this then involved a wider examination about how the ESCALATION system and pathway response could work in all hospital environments. The result is a highly refined ESCALATION system, fit for purpose, which is likely to be well accepted across a health system that has substantial contextual variation.
The ESCALATION system scoring represented a significant practice and behaviour change for many intended users across a variety of clinical settings. Change management research has shown that smaller differences between current work practices and new processes make implementation easier.37 We considered that optimising staff preparation for behaviour change to be a key step towards ensuring implementation success. A completion rate of 80% by health professionals for the online education package increased reach opportunity, and further supported site implementation success.
Through delivering education in preparation for implementation we identified gaps in nurses’ knowledge and skills related to clinical assessment of children, in particular uncertainty and conjecture about measuring blood pressure. Low rates of measuring blood pressure in children have long been reported38,39 Barriers described include concerns about measurement accuracy, lack of available equipment as well inability to remember acceptable parameters for different age ranges.38 We attempted to address knowledge and skill gaps in our context by refining the education content to include more explicit information and instruction for nurses who may be less confident caring for children.40 However, the reality of narrowing this theory-practice gap appears to be too complex to be resolved simply through in-service education and supply of equipment. This continues to be a conundrum for all paediatric EWS that include manual recording of variables.39,41,42
Our feasibility and acceptability assessment specifically focused on the new system feature of integrated family involvement through the clinician/family concern variable. Initially we found health professional attitudes varied across settings and appeared to be associated with whether individuals had received preparation. Attitudes towards the clinician/family concern variable became more favourable over time. This finding is reflected in the literature reporting increasingly more positive views of health professionals towards family and patient involvement in escalation of care43 and patient safety initiatives.44 The experiences of families strongly supported integrated family involvement in the ESCALATION system and highlighted for the system to work as intended, effective communication between health professionals and families in hospital is key.
The major strengths of this study were the systematic and theoretically informed approach, sustained stakeholder engagement and diverse data sources collected across several hospitals over four time periods enabling refinements to be made iteratively to suit contextual variations. There are several study limitations to acknowledge. The evaluation of families’ experience of involvement was limited to a small number of participants who were English speaking and health literate. Our findings may not reflect views or experiences of families with lower health literacy or low language proficiency; known risk factors associated with patient safety incidents in hospital.45 Specifically, we did not examine the influence of cultural and linguistic diversity on families’ capacity to be involved. The willingness and ability of families to be involved in assessing their child, recognising changes and escalating care is underpinned by assumptions that families can recognise clinical deterioration and feel safe, confident and adequately prepared to raise their concerns. Health consumers from culturally and linguistically diverse backgrounds have reported having little experience questioning doctors or shared decision making in healthcare.46 Not yet fully understood is the magnitude of the impact of cultural and language barriers, low health literacy, power imbalance and low level of cultural safety experienced in the hospital environment.13,47 We previously reported on family involvement in escalation of care for Aboriginal children in hospital, finding that more effective, culturally relevant communication by health professionals is needed.48 Further research is required to understand how to effectively enable the most vulnerable families in hospital to be involved in recognising and responding to changes to their child’s condition.
The components of the ESCALATION system included the structured communication ISOBAR NOW. Whilst feedback from health professionals was positive about ISOBAR NOW, it was evident this component of the intervention was not used fully as intended. The ESCALATION system, a complex intervention, is composed of several interacting components where implementation involved substantial cognitive, behaviour and practice changes. At the time of implementation, equal emphasis was not placed on the communication component and proved insufficient to achieve cultural change. Fully implementing the communication elements of the ESCALATION system in the future will require a targeted approach.
Conclusion
The standardised evidence-based ESCALATION system is designed to facilitate early recognition and response to paediatric clinical deterioration with integrated family involvement, sepsis recognition prompts and an escalation pathway with a supported communication framework. Our series of studies was conducted over four time periods across several hospitals, each with contextual variations within a large Australian state. We systematically assessed feasibility, acceptability and examined concepts of Implementation, Context and Mechanisms of Impact from the perspectives of users. Iteratively refining the system in this way enabled development of an acceptable and feasible intervention ready for full-service implementation. Our education preparation package targeted identified gaps in nurses’ paediatric clinical assessment knowledge and practices. More targeted work will be required to support full use of the communication framework component. Further research is required to understand how best to support all families to be involved in recognising and responding to changes in their child’s condition. Our approach highlighted the importance of adequate preparation for complex intervention implementation. Continuing intervention effectiveness and long-term sustainability will require ongoing monitoring and evaluation, often overlooked in implementation research.
The data that support the findings of this study are available from Fenella Gill but restrictions apply to the availability of these data. The Human Research Ethics Committee did not approve the data to be publicly available. Data are however available from the authors upon reasonable request and with permission of Fenella Gill.
References
Chen, J. In Search of the ‘Best’ Rapid Response Early Warning System – the Journey Has Just Begun. Resuscitation 123, A1–A2 (2018).
Government of Western Australia Department of Health. Independent Inquiry into Perth Children’s Hospital. 2021 [cited 2024 Jul 30]; Available from: https://ww2.health.wa.gov.au/Reports-and-publications/Independent-Inquiry-into-Perth-Childrens-Hospital.
Office of the Health Ombudsman. Review into the Quality of Health Services Provided by Bamaga Hospital, Queensland. Office of the Health Ombudsman; 2020.
Coroner’s Court of Queensland. Non-inquest findings into the death of nearly 16 month old girl, LM. Brisbane, Queensland Australia; 2018.
Coroner’s Court of Queensland. Non-inquest findings into the death of C. Brisbane, Queensland, Australia; 2020.
Coroner’s Court of Western Australia. Inquest into the Death of Malakai Paraone. Perth, Western Australia; 2020.
Coroners Court of Western Australia. Record of Investigation into Death. Findings of BP King. Perth, Western Australia; 2020.
Coroners court of Western Australia. Inquest into the Death of Aishwarya Aswath Chavittupara. Perth, Western Australia; 2023.
Office of the State Coroner. Inquest into the Death of Ryan Charles Saunders. Rockhampton, Queensland, Australia; 2011.
Craig, P. et al. Developing and evaluating complex interventions: the new medical research Council Guidance. BMJ 337, a1655 (2008).
Craig, P. et al. Developing and evaluating complex interventions: new guidance. Medical Research Council and National Institute Health Research; 2021.
Gill, F. J., Leslie, G. D. & Marshall, A. P. Barriers and facilitators to implementing a process to enable parent escalation of care for the deteriorating child in hospital. Health Expect. 21, 1095–1103 (2018).
Thiele, L., Flabouris, A. & Thompson, C. Acute clinical deterioration and consumer escalation in the hospital setting: a literature review. Resuscitation 156, 72–83 (2020).
Schlapbach, L. J., Thompson, K. & Finfer, S. R. The who resolution on sepsis: what action is needed in Australia? Med. J. Aust. 211, 395–397.e391 (2019).
Weiss, S. L. et al. Surviving sepsis campaign international guidelines for the management of septic shock and sepsis-associated organ dysfunction in children. Pediatr. Crit. Care Med. 21, e52–e106 (2020).
Australian Sepsis Network. Stopping Sepsis a National Action Plan. 2017 [cited 2024 Jul 30]; Available from: https://www.australiansepsisnetwork.net.au.
Australian Commission on Safety and Quality in Health Care. Sepsis Clinical Care Standard. 2022 [cited 2024 Jul 30]; Available from: https://www.safetyandquality.gov.au/standards/clinical-care-standards/sepsis-clinical-care-standard.
Government of Western Australia Department of Health. About Us. 2024 [cited 2024 Jul 30]; Available from: https://www.health.wa.gov.au/About-us.
Gill, F. J., Cooper, A., Falconer, P., Stokes, S. & Leslie, G. D. Development of an evidence-based escalation system for recognition and response to paediatric clinical deterioration. Aust. Crit. Care 35, 668–676 (2022).
Hawkins, J. et al. Development of a framework for the co-production and prototyping of public health interventions. BMC Public Health 17, 689 (2017).
Campbell, M. et al. Framework for design and evaluation of complex interventions to improve health. Br. Med. J. 321, 694–696 (2000).
Sidani, S. & Braden, C. J. Nursing and Health Interventions : Design, Evaluation, and Implementation (John Wiley & Sons, Incorporated, 2021).
Moore, G. F. et al. Process evaluation of complex interventions: medical research council guidance. BMJ 350, h1258 (2015).
Graham, I. D., McCutcheon, C. & Kothari, A. Exploring the frontiers of research co-production: the integrated knowledge translation research network concept papers. Health Res. Policy Syst. 17, 88 (2019).
Australian Commission on Safety and Quality in Health Care. Audit Tools and Quality Measures for Recognition and Response Systems. no date [cited 2016 March 2]; Available from: http://www.safetyandquality.gov.au/our-work/recognising-and-responding-to-clinical-deterioration/evaluating-recognition-and-response-systems/quality-measures-for-recognition-and-response-systems/.
Kinney, S., Sloane, J. & Moulden, A. Statewide paediatric observation and response Chart (SPORC) Project. The Paediatric Clinical Network, Department of Health, Victoria, Melbourne, Victoria, Australia; 2014.
Cooper, A. et al. Using clinical simulation to assess a new paediatric escalation system education package: empirical research mixed methods. Nurs. Open 11, e2100 (2024).
Yu, Y., Xiao, L. & Chamberlain, D. J. Perceptions of care in patients from culturally and linguistically diverse background during acute and critical illness: a integrative literature review. Aust. Crit Care 34, 486–495 (2020).
Elliott, D. et al. User acceptance of observation and response charts with a track and trigger system: a multisite staff survey. J. Clin. Nurs. 25, 2211–2222 (2016).
Pawson, R. & Tilley, N. Realistic Evaluation (Sage, 2004).
Guba, E. & Lincoln, Y. Fourth Generation Evaluation (Sage Publications, 1989).
Hsieh, H.-F. & Shannon, S. E. Three approaches to qualitative content analysis. Qual. Health Res. 15, 1277–1288 (2005).
Creswell, J. & Creswell, J. Research Design: Qualitative, Quantitative and Mixed Methods Approaches 5th edn, (Sage Publications, Inc, 2018).
Guetterman, T., Fetters, M. & Creswell, M. Integrating quantitative and qualitative results in health science mixed methods research through joint displays. Ann. Fam. Med. 13, 554–561 (2015).
Tong, A., Sainsbury, P. & Craig, J. Consolidated Criteria for Reporting Qualitative Research (Coreq): A 32-Item Checklist for Interviews and focus groups. Int. J. Qual. Health Care 19, 349–357 (2007).
Pinnock, H. et al. Standards for Reporting Implementation Studies (Stari): explanation and elaboration document. BMJ Open 7, e013318 (2017).
Clay-Williams, R., Hounsgaard, J. & Hollnagel, E. Where the rubber meets the road: using fram to align work-as-imagined with work-as-done when implementing clinical guidelines. Implement. Sci. 10, 125 (2015).
Bird, C. & Michie, C. Measuring blood pressure in children. Br. Med. J. 14, 1321 (2008).
Considine, J. et al. Importance of specific vital signs in nurses’ recognition and response to deteriorating patients: a scoping review. J. Clin. Nurs. 33, 2544–2561 (2024).
Ilangakoon, C., Jones, T., Innes, K. & Morphet, J. Caring for deteriorating paediatric patients in the emergency department: a mixed method study. Australas. Emerg. Care 23, 252–258 (2020).
Chapman, S. M., Oulton, K., Peters, M. J. & Wray, J. Missed opportunities: incomplete and inaccurate recording of paediatric early warning scores. Arch. Dis. Child 104, 1208–1213 (2019).
Trubey, R. et al. Validity and effectiveness of paediatric early warning systems and track and trigger tools for identifying and reducing clinical deterioration in hospitalised children: a systematic review. BMJ Open 9, e022105 (2019).
Thiele, L., Flabouris, A. & Thompson, C. Acute clinical deterioration and consumer escalation: the understanding and perceptions of hospital staff. PLoS ONE 17, e0269921 (2022).
Giap, T.-T.-T. & Park, M. Implementing patient and family involvement interventions for promoting patient safety: a systematic review and meta-analysis. J. Patient Saf. 17, 131–140 (2020).
Chauhan, A. et al. The safety of health care for ethnic minority patients: a systematic review. Int. J. Equity Health 19, 118 (2020).
Australian Commission on Safety and Quality in Health Care. Consumer Health Information Needs and Preferences: Perspectives of Culturally and Linguistically Diverse and Aboriginal and Torres Strait Islander People. 2017 [cited 2024 Jul 30]; Available from: https://www.safetyandquality.gov.au/publications-and-resources/resource-library/consumer-health-information-needs-and-preferences-perspectives-culturally-and-linguistically-diverse-and-aboriginal-and-torres-strait-islander-people.
Rheault, H., Coyer, F., Jones, L. & Bonner, A. Health literacy in indigenous people with chronic disease living in remote Australia. BMC Health Serv. Res. 19, 523 (2019).
Gill, F. J., Cooper, A. L., Laird, P. & Leslie, G. D. Aboriginal perspectives on recognising clinical deterioration in their child and communicating concerns to clinicians. J. Pediatr. Nurs. 63, e10–e17 (2021).
Acknowledgements
We acknowledge the support of Child and Adolescent Health Service, the contribution of the Project Steering Group, the Working Groups, the Health Consumer Groups and study participants.
Funding
This work was supported by a 2018 West Australian Health Translation Network and Curtin University Fellowship in Research Translation. Open Access funding enabled and organized by CAUL and its Member Institutions.
Author information
Authors and Affiliations
Contributions
Substantial contributions to conception and design F.J.G., P.F., A.C., and G.D.L. acquisition of data, F.J.G., P.F., A.C., S.S., A.R., and M.Z. analysis and interpretation of data; F.J.G., P.F., A.C., A.R., and G.D.L. Drafting the article or revising it critically for important intellectual content; and F.J.G., A.C., S.S., M.Z., A.R., P.F., and G.D.L. Final approval of the version to be published F.J.G., A.C., P.F., S.S., A.R., M.Z., G.D.L.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Consent to participate
Informed participant consent was obtained from health professionals and families of paediatric patients.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Gill, F.J., Cooper, A., Falconer, P. et al. Feasibility and acceptability of implementing an evidence-based ESCALATION system for paediatric clinical deterioration. Pediatr Res (2024). https://doi.org/10.1038/s41390-024-03459-y
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41390-024-03459-y
- Springer Nature America, Inc.