Background

Exsanguinating haemorrhage is one of the leading causes of death in patients suffering major trauma [1]. Besides catastrophic external haemorrhage, blood loss may occur from thoracic, abdominal, pelvic or limb injuries. Any of these alone or in combination can produce significant hypovolemia. Especially injury to the bony pelvis with disruption of the pelvic ring and damage to adjacent blood vessels may cause severe bleeding and can be associated with considerable morbidity and mortality [2,3,4]. As substantial force is required to cause fracture of the pelvic ring, some of the most frequent mechanisms of this injury involve road traffic accidents, falls from height and localized crush injuries [5, 6]. However, in the elderly with osteoporosis, disruption of the pelvic ring can also occur from low-energy mechanism [7]. Pelvic ring fractures may be classified in a number of ways. Most commonly, the Tile [8] and Young-Burgess [9] classification systems are used. These divide pelvic ring injuries into various types based on stability/instability of the posterior sacroiliac complex (Tile type A: stable, Tile type B: rotationally unstable, Tile type C: vertically and rotationally unstable) and vector of injuring force (lateral compression types, anterior-posterior types, vertical shear types and combined mechanisms) respectively. Considering the potentially life-threatening haemorrhage associated with pelvic ring fractures, rapid identification and management are critical to optimize patient outcomes.

Historically, prehospital management in the form of pelvic binding was performed when inspection and palpation of the pelvis revealed deformity, instability and pain. However, the diagnostic reliability of identifying a pelvic fracture by physical examination is questionable, particularly in the patient with decreased level of consciousness [10,11,12]. Furthermore, manipulating and especially springing the pelvis carries significant risk of disrupting any clot that may have formed and thus interfering with any spontaneous haemostasis [11]. Therefore, the decision to apply a pelvic circumferential compression device (PCCD) in any blunt trauma patient with suspected pelvic ring fracture based predominantly on the mechanism of injury and any visual signs such as bruising around the pelvis is increasingly being advocated as best practice in the prehospital care [13,14,15]. As the name implies, the intended purpose of a PCCD is to wrap around and stabilize the pelvic ring thereby limiting haemorrhage from cancellous bone or venous sources. The placement of a PCCD on a patient with a mechanism of injury suggestive of pelvic ring disruption is now commonly regarded to be an indicator of high-quality prehospital trauma care [13,14,15]. As such, many ambulance services utilize this quality indicator (QI) in the measurement of their clinical performance [16].

A QI is an explicitly defined and measurable aspect of health care services indicative of a desirable structure, process or outcome [17]. That is to say, there is evidence and/or consensus that the indicator can be used to quantify the quality of service provided, and thus monitor changes in quality over time [18]. This measurement provides a tool to identify unwarranted variation, facilitate data-driven improvement efforts and assess their impact. Systematically developed QIs are ideally based on scientific evidence. This may stem from rigorously developed guidelines [19, 20], but preferably is based directly upon high-quality scientific evidence such as thoroughly conducted (trial-based) empirical studies or robust systematic reviews and meta-analyses of randomized controlled trials (RCT) [17, 21]. In areas or disciplines where such evidence is scarce, it may be necessary to combine the best available evidence with expert consensus [17, 22]. Since the methodical review of underpinning evidence is fundamental to the systematic development of quality indicators, the expert consensus process should also be evidence-informed. The RAND/UCLA appropriateness method (RAM) is a formal group judgement process developed in the 1980s by the Research and Development (RAND) Corporation and the University of California, Los Angeles (UCLA) [23]. It combines expert opinion and scientific evidence in the form of systematic literature reviews by asking panellists to rate, discuss, and then re-rate statements.

However, this prominent advantage that RAM has over other consensus processes may also be a deterring factor. A systematic review is conducted to provide the expert panel with all pertinent information that will guide evidence-based decision-making [23]. Due to the rigorous methods applied when conducing full systematic reviews, they can take an extensive period of time to complete [24, 25]. This may be particularly problematic when multiple areas are being covered, there is high complexity in the topic, or both. Rapid reviews are a form of knowledge synthesis in which components of the systematic review process are simplified or omitted to produce information in a more timely manner [26]. As such, rapid reviews may offer a time- and resource-efficient alternative to modify RAM and prevent a potentially protracted and misaligned decision timeline. Although the rapid review approach has several inherent limitations, it may be a suitable compromise to facilitate swift synthesis of available evidence and adequately inform decisions in a RAM expert consensus process.

The aim of the present study was to apply rapid review methods to identify, appraise and summarize the best available evidence regarding PCCDs and in doing so provide an evidence summary to inform an expert panel tasked to validate the QI used for the measurement of prehospital trauma care quality. More specifically, this rapid review aimed to investigate current evidence for the effectiveness and safety of non-invasive PCCDs. This study forms part of a larger research project aimed at developing and testing prehospital care quality indicators for the Australian setting (https://www.aspireproject.net).

Methods

Preliminary work

As the initial part of the larger research project, a scoping review was conducted in accordance with Joanna Briggs Institute (JBI) methodology [16]. The scoping review’s purpose was to map the attributes of ‘quality’ in the context of prehospital care, to chart existing international prehospital care QIs and explore their development processes. Identified QIs were categorized as either system/organizational/non-clinical (domain A) or clinical (domain B). Within these two domains, several sub-domains were formed, including ‘trauma care’ (sub-domain B.6). QIs describing in one way or another the application of a PCCD in a patient with suspected pelvic fracture were identified in several included articles and aggregated into one single QI concisely describing the specific clinical intervention (Table 1). Furthermore, the QI was labelled as a process indicator according to Donabedian’s model, and as a QI primarily addressing ‘effectiveness’, one of the attributes of ‘quality’ mapped in the review.

Table 1 The aggregated quality indicator originating, amongst others, from the preliminary scoping review

Rapid review

Literature search strategy

Guided by the approaches to rapid reviews and evidence summaries by JBI and the World Health Organization (WHO) [27], a rapid systematic literature review was conducted to develop a summary of the best available evidence concerning the placement of a PCCD in the prehospital environment. Systematic searches of four electronic databases (the Cochrane Library, the JBI Database of Systematic Reviews, PubMed and CINAHL) were conducted on 9 June 2020. No date range filters were set but the search was limited to studies involving human participants and written in English. Due to the small number of systematic reviews identified, the search was expanded to include lower levels of evidence [28]. Nevertheless, observational descriptive studies, case series and case reports were excluded, as were non-systematic literature reviews. The full search strategy is available in Appendix S1.

Study selection

One author (RP) carried out the literature search, screened the results by title and abstracts using Covidence (Covidence, Melbourne VIC, Australia), and performed full-text review of shortlisted articles based on pre-defined inclusion criteria. The pre-defined inclusion criteria were based on the following population, intervention, comparison, outcome, context, study design (PICOCS) criteria:

  • Population: Trauma patients with suspected or confirmed pelvic fracture(s)

  • Intervention: Application of a PCCD

  • Comparison: No intervention (or wrapping sheet)

  • Outcomes: Clinical endpoints and/or adverse effects

  • Context: Emergency trauma care

  • Study designs: Systematic review, experimental and quasi-experimental studies, and observational analytical studies.

Quality appraisal

Following the search, studies selected for retrieval were assessed for internal validity using applicable JBI critical appraisal checklists [27]. This risk-of-bias assessment was performed by one author (RP). The quality threshold scores on respective checklists was 7 out of 11 for systematic reviews, 8 out of 13 for randomized control trials, 6 out of 9 for quasi-experimental studies and 7 out of 11 for cohort studies. These scores equated to a minimum quality threshold of 60% which was deemed to indicate sufficient quality for the research to be included in the review.

Data extraction and synthesis

Data were extracted by one author (RP) and verified by another (RM) using a standardized extraction template created a priori in Microsoft Excel for Mac 2019 (Microsoft Corp., Richmond, WA, USA). For systematic reviews, the following data were extracted: author(s), year of publication, number of studies included their designs, whether meta-analysis was performed and key findings. For primary research studies, following data were extracted: author(s), year of publication, study objectives and design, number of participants, participant characteristics, device(s), and key findings. Each systematic review and primary study was assigned a level of evidence in accordance with JBI [28].

Results

Search and critical appraisal results

A total of 1194 potentially relevant records were identified through database searching (Fig. 1). Following the removal of 38 duplicates, 1156 records were retrieved for title and abstract screening. This found 1108 records to be incongruent with the inclusion criteria which were thus excluded and left 48 articles for full-text screening. Subsequently, 35 articles were excluded based on incompatibility with the review criteria which resulted in 13 articles being included for analysis in this rapid review. The 13 articles were critically appraised for methodological quality using applicable JBI critical appraisal tools. Based on the a priori minimum scores, all studies were included in this review.

Fig. 1
figure 1

PRISMA flow chart of study inclusion

Description of the studies and characteristics of the evidence

Three systematic reviews [29,30,31], one randomized clinical trial (crossover design) [32], two before-after studies [33, 34], and seven retrospective cohort studies [35,36,37,38,39,40,41] were included (Tables 2 and 3). For systematic reviews, the level of evidence was assigned with consideration of included studies which addressed physiological effects and clinical outcomes such as reducing bleeding and decreasing mortality. Similar to the hierarchical rating of outcomes according to importance performed in the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach [42], these outcomes were considered most critical and thus given priority over other, less important outcome measures such as biomechanical effects in determining evidence level.

Table 2 Summary of included systematic reviews
Table 3 Summary of included primary clinical studies

Summary of the evidence and clinical bottom line

Tables 2 and 3 provide summaries of the included studies’ findings. Generally, the evidence in support of the application of a PCCD in a patient with suspected or confirmed pelvic fracture is weak. Whilst three systematic reviews were identified, the design of included studies (mostly observational) in these reviews lowered their level of evidence. None of the systematic reviews included a meta-analysis of included studies. Bakhshayesh, et al. (2016) [29] explicitly stated that it was not possible to combine results due to heterogeneity amongst included studies. This heterogeneity is echoed in the primary clinical studies identified in this rapid review making synthesis of results challenging. Furthermore, the limited clinical research is comprised predominantly of historical cohort studies, which induces inherent and considerable risk of bias.

Included studies which address the biomechanical effects of PCCDs indicate the devices facilitate a reduction in pelvic volume and improvement in biomechanical stability [29,30,31, 33, 34]. Of the included studies, several suggest that PCCDs, especially if applied early, may contribute to a variety of desirable physiological effects [29,30,31, 33, 37, 38, 40]. Yet, results concerning other, more critical outcome measures such as mortality and hospital or intensive care unit length of stay are ambivalent or conflicting [29,30,31, 35,36,37, 39, 41]. Three studies included sheet wrapping as an improvised method to stabilize the pelvic ring [38, 39, 41]. However, only one of these (Pizanis, at al. 2013) [39] compared this method to the application of a commercial PCCD and demonstrated benefits in using a PCCD over improvised pelvic binding in reducing mortality. The systemic reviews consistently report on potential adverse effects of PCCDs. These including mostly skin damage, myonecrosis and peroneal nerve palsy when used for extended periods of time, but also injury to internal organs as a result of shearing forces during the application process [29,30,31].

The clinical bottom line is that there is no high-level evidence that the application of a PCCD reduces haemorrhage or mortality in suspected or confirmed pelvic fractures. The best available evidence suggests that a PCCD provides temporary pelvic ring stabilization and can serve as an adjunct to early haemorrhage control. The application of PCCD carries a certain potential for iatrogenic harm, however, clinical benefits seem to outweigh this risk. Given the limited data to show undisputable benefit, further research on this topic is needed. In particular, there is a lack of research in the prehospital arena as well as studies which examine the effectiveness and safety of PCCDs in specific pelvic fractures types according to Young-Burgess classification as this mechanistic classification is more practical for the prehospital context.

Discussion

Patients suffering pelvic fractures are at risk of severe and potentially life-threatening bleeding [43, 44]. Especially patients with unstable pelvic fracture types are at high risk of exsanguinating haemorrhage [45, 46]. Palpation of the pelvis is unreliable in detecting instability and has been associated with dislodging clots and initiating further blood loss [47]. Therefore, in early major trauma care, the presence of pelvic disruption should be based on suspicion after consideration of the mechanism of injury rather than confirmation by physical examination. PCCDs have been shown to provide effective biomechanical reduction in partially stable and unstable pelvic fractures [48]. A clinically reasonable assumption is that the prompt application of a PCCD facilitates early stabilization of unstable fractures and thus leads to favourable physiological effects and ultimately desirable patient outcomes. This rapid review aimed to summarize current evidence for the effectiveness and safety of non-invasive PCCDs and identified several, albeit methodologically weak studies in support of the intervention. As such, this rapid review was unable to identify high-quality evidence and the best available evidence should be combined with expert consensus in a process such as RAM to assess the validity of the QI under discussion.

Health care quality measurement and improvement are complex endeavours. Considering the resources health care organizations invest in them and the potential adverse consequences if conducted poorly [49, 50], it is important to get it right from the start. Unfortunately, indicators are often chosen because the required data is easily attainable rather than because they are evidence-based [51]. When indicators are developed or transferred between health care systems, it is critical to review their supporting evidence and the quality thereof [52, 53]. A QI is preferably based on high-quality evidence clearly demonstrating that the desirable effects outweigh the undesirable effects. Such evidence is produced by large, thoroughly conducted RCTs that demonstrate consistent impressive benefits with limited adverse effects and minimal cost. In the absence of such high-quality evidence, best available evidence should be combined with expert consensus to assess the validity of the indicator. Therein lies the essence of a quality indicator and what distinguishes it from a performance indicator – a QI has scientific credibility, i.e. there is evidence and/or expert consensus that the indicator can be used to make a judgement about quality [17]. Not only are health care quality improvement managers increasingly required to deploy such scientific methods to develop measures of quality, but also they are required to do so in limited amounts of time [54]. This presents a potential misalignment between QI development and timelines set by organizational quality improvement needs [55, 56]. This paper presents an example of a fast-tracked systematic literature review methodology which balanced its scope against time and resource constraints, and in doing so may prevent protraction and provide a timely evidence summary to inform QI development. From inception to completion this rapid review took approximately 3 months; a relatively short timeframe compared to full systematic reviews which commonly take 12 to 24 months to complete [57, 58].

There are several significant limitations that the omission or simplification of systematic review methods induce. The search strategy was limited by restricting the number of databases consulted, excluding all non-English language papers, using more specific search terms and excluding lower levels of evidence. Databases were restricted in line with guidance for rapid reviews and evidence summaries by JBI. Whilst systematic reviewer and meta-analysts should conduct exhaustive searches in multiple databases, rapid reviews commonly omit several databases to focus on those expected to yield best results. This approach is justifiable by studies which have demonstrated only marginal improvement in relevant results by increasing the number of databases searched [59, 60]. The search for studies in rigorously conducted systematic reviews should not be restricted by language. Limiting results to those written in English inevitable introduces English language bias or Tower of Babel bias potentially leading to an over- or underestimation of an intervention’s effectiveness [61]. Reliable translation services, however, require time and financial resources making them a less suitable part of a rapid review search strategy. Optimal search strategies aim for maximum number of relevant references with minimal noise, i.e. best sensitivity and specificity. In this balance, rapid reviews commonly lean towards specificity. The search terms in this rapid review were more specific by using narrower MeSH terms (e.g. MH “pelvic fractures”), using Boolean operators to narrow MeSH headings (e.g. (pelvic bones [mh] OR pelvis [mh]) AND (fractures, bone [mh] OR wounds and injuries [mh]) and by avoiding less common keywords (e.g. splint). JBI evidence summaries are ideally based on several systematic reviews, however, when no systematic reviews are identified, lower levels of evidence are included [27]. This rapid review adopted the approach but leaned towards more comprehensive inclusion by lowering the methodological exclusion threshold to observational descriptive studies. Whilst data extraction was verified by a second reviewer, the preceding study selection and quality appraisal was performed by only one reviewer. Expediting the review process in this way is frequently done in rapid reviews, however, introduces considerable risk of bias and error.

Conclusion

This study provides an example of how the timely knowledge synthesis through the deployment of a streamlined rapid review approach can inform QI development. More specifically, the study has reviewed best available evidence regarding the application of a PCCD in patients with suspected pelvic fractures and summarized this into a synopsis for feasible consideration by an expert panel tasked to assess the validity of a related QI. The process of applying a PCCD is not clearly linked to desirable clinical outcomes and does carry a potential for iatrogenic harm. Nevertheless, the clinical benefits seem to outweigh risks. This best available evidence is of low quality strengthening the need for its perusal by an expert panel before possible QI implementation.