Introduction

Carpal fractures account for 8% of all hand fractures of which scaphoids are the most common [1]. Early diagnosis of these fractures is important as delay may result in considerable morbidity arising from complications such as non-union, carpal instability, osteoarthritis or avascular necrosis [2].

Radiographs are the initial imaging modality of choice but display a relatively poor diagnostic accuracy with a sensitivity between 66 and 81% for scaphoid fractures, 39% for carpal fractures overall, and 58% for wrist fractures [3, 4]. Cross-sectional imaging provides a higher diagnostic yield. For scaphoid fractures, conventional computerized tomography (CT) has a sensitivity and specificity of 82% and 96% respectively, whilst magnetic resonance imaging (MRI), considered the gold standard, has the highest sensitivity and specificity of 94% and 98% respectively [5].

Carpal fractures are often radiographically occult, with up to 30% of fractures missed on radiographs [4]. Multiple factors contribute to their difficult detection including overlapping structures, poor technique, suboptimal positioning and lack of dedicated special radiographic views. Traditionally, unlike for other carpal bones, patients with radiographically occult scaphoid fractures are immobilized in a cast for two weeks followed by repeated clinical and radiological examination. This old dictum results in significant overtreatment with eventually only 4–20% of patients being diagnosed with scaphoid fractures [6]. Therefore, most protocols now recommend early MRI or CT for suspected scaphoid fractures [7]. Despite this, there is significant heterogeneity in imaging techniques employed in UK centres—only 51% of respondents to a recent survey offering MRI to patients within 2 weeks, with accessibility and cost-implications commonly reported limitations [8].

Cone-beam CT (CBCT), utilized extensively in the field of dentistry since the 1990s, is increasingly being investigated for the evaluation of radiocarpal fractures. CBCT uses a large, flat area detector and a cone-shaped X-ray beam to acquire volumetric data from multiple projections in a single rotation around an object (Fig. 1) [9]. Compared to conventional multidetector CT (MDCT), CBCT produces high spatial resolution images at a low radiation exposure, further reduced by scanner design which allows shielding of radiosensitive organs [10].

Fig. 1
figure 1

ac Schematic illustrating the differences in image acquisition of CBCT compared to conventional CT. a CBCT utilizes a cone-shaped beam recorded by a flat-panel detector, requiring only a single rotation around an object. b Conventional CT device utilizes an X-ray beam is a fan-shape and is detected by an arc shaped panel rotating in a direction opposite to the X-ray source. c Position of a patient during CBCT performed of the wrist

CBCT has been shown to perform significantly better than radiography in the detection of small bone and joint fractures and may have a diagnostic value at least similar to MDCT [11]. As CBCT is fast to perform and likely has a higher diagnostic yield than radiography, it may have particular utility for the diagnosis of radiographically occult extremity fractures in the acute trauma setting [12, 13]. However, the accuracy and efficacy of CBCT are yet to be proven for radio-carpal fractures. The objective of this study is to investigate the accuracy of CBCT in the diagnosis of radiocarpal fractures.

Methodology

Design

A study protocol set out the objectives of the review, study inclusion criteria and methods of analysis and was prospectively registered with PROSPERO (CRD42021224232). The review was reported in accordance with Preferred Reporting Items for Systematic Review and Meta-analysis (PRISMA) of diagnostic test accuracy studies.

Criteria for considering studies for this review

Retrospective observational, cohort or cross-sectional and prospective studies that assessed the use of CBCT in the diagnosis of scaphoid fractures were included. Case studies and reports of less than five patients, review articles, conference abstracts, meta-analysis and commentaries were excluded. As CBCT is an emerging imaging modality for upper limb extremity injuries, included studies could not be restricted to randomised controlled trials due to lack of available data.

Participants

All participants over the age of 18 who presented with acute traumatic carpal or distal radius injuries which were imaged using CBCT were included. Bony injuries included distal radius, carpal, and scaphoid fractures, which were managed surgically or conservatively with clinical follow-up.

Target condition

Radiocarpal fractures were defined as fractures of the distal radius and any carpal bone. Carpal bone fractures were defined as fractures of any carpal bones, including the scaphoid. We also included injuries where there was ongoing clinical suspicion of scaphoid and other radiocarpal cortical fractures, despite an initial negative radiograph. Injuries with negative initial radiographs which had ongoing clinical suspicion of injury were also included.

Index test

CBCT uses a cone-shaped X-ray beam and 2-D detectors with multiple pixels in the x and y axis, instead of a one-dimensional detector and a fan-shaped X-ray beam as for a fan-beam CT detector [14, 15]. Compared to conventional CT, cone-beam CT (CBCT) has a higher resolution, 90% lower radiation and a faster scanning time [14]. It thus reduces examination time and provides less movement artefacts. However, it requires an appropriate reconstruction algorithm and increases scattered radiation. Recent studies have demonstrated CBCT may have similar accuracy in detecting occult fractures of the wrist and scaphoid bone as MRI [5, 15, 16].

Reference standards

Plain radiographs are the standard initial imaging modality for suspected radiocarpal injuries, usually including posteroanterior (PA), true lateral, oblique, and scaphoid views of the wrist. All patients included in the study underwent radiographs and CBCT. MRI scan is the gold standard imaging modality for radiocarpal fractures and was used on its own or in combination with clinical follow-up and surgical findings as a reference standard [10, 15, 17,18,19].

Search methods for identification of studies

The literature search was undertaken in December 2020 over a 3-week period by two review authors (EF and VS). The Healthcare Databases Advanced Search (HDAS) interface by the National Institute for Health and Care Excellence (NICE) was used to run searches in the PubMed/Medline/EMBASE databases. A list of search strategy keywords was compiled and used to search the literature (Supplementary material). Only studies in English were included.

Data collection and analysis

Selection of studies

Eligible studies were assessed by two review authors (EF, VS) independently. A third author (DMR) acted as an arbitrator when consensus could not be reached between the first two. Titles and abstracts of the electronic database search results were first screened, as shown in the PRISMA diagram in Fig. 2. Full-text articles of the studies meeting the included criteria were then reviewed.

Fig. 2
figure 2

The PRISMA diagram for the search strategy

Data extraction

Data was retrieved by one review author (EF) and cross-checked by a second author (VS). The following data were extracted from the full-text articles of the selected studies:

  • Article (author, year and journal of publication)

  • Study design (sample size, type of study)

  • Study population and demographics (age, gender)

  • Reference standard (clinical follow-up, MRI scans, intraoperative findings)

  • Index test (CBCT) and its interpretations

  • Quality assessment of the included studies using the Quality Assessment of Diagnostics

  • Accuracy Studies (QUADAS-2) tool [20]

  • Absolute number of true positives, true negatives, false positives, false negatives, sensitivity, specificity, accuracy for two-by-two contingency tables

Assessment of methodological quality

The methodology of the selected studies was assessed using the revised QUADAS-2 tool on RevMan 5.3 (Cochrane Collaboration, Copenhagen, Denmark). The four domains used to assess the risk of bias were participant selection, index test, reference standard and flow and timing. Applicability was assessed for the first three domains, within each domain the questions were answered with “yes”, “no” or “unclear” and the risk of bias was classified as “low”, “high” or “unclear”. The methodological quality assessment was performed by two review authors (EF, VS) independently.

Statistical analysis and data synthesis

Dichotomous outcomes for both the reference standard and index test were obtained from the included studies. Two by two contingency tables were constructed and classified according to the reported true positives, true negatives, false positives and false negatives. Sensitivity and specificity with 95% CI were calculated for each study using RevMan 5.3 and presented through forest plots. A mixed-effects logistic regression bivariate model was used to meta-analyse each index test interpretation individually, where logit transformed sensitivities and specificities were modified. Summary receiver operating characteristic (SROC) curves were constructed and summary sensitivities and specificities were computed. Through this, we obtained diagnostic odds ratio (DOR) and positive (LR+) and negative (LR−) likelihood ratios. Hierarchical modelling was performed to generate hierarchical summary ROC (HSROC) curves to present summary points, 95% confidence regions and 95% prediction regions. Studies reporting inter-observer agreement for index test interpretation were meta-analysed using a mixed-effects model through calculated standard errors from the reported agreement coefficients [21]. All analysis was undertaken using “metan”, “midas” and “metandi” commands in Stata 16 (StataCorp, College Station, TX, USA).

Assessment of reporting bias

We have only included 5 studies, which is not a sufficient number for reporting bias using a funnel plot [22].

Results

Results of search

The literature search performed on the Healthcare Databases Advanced Search (HDAS), including Medline, PubMed and EMBASE, for “scaphoid”, “hand/s”, “carpal/s”, “distal radius” or “distal radial” produced 626,704 results. “Injury/s”, “trauma” or “fracture/s” produced 1,031,290 results. “Cone beam computed tomography”, “cone beam CT”, “CBCT” or “CB-CT” produced 14,092 results. A combination of all three searches obtained 43 results. The title and abstract screen of the 43 results produced nine papers. Two papers used the same data; the paper which focused on scaphoid fracture was included [12, 23]. One paper did not distinguish between the results of upper and lower limb fractures and was therefore excluded [24]. The other two studies were irrelevant and therefore not included [11, 25]. Five studies were included in the paper [10, 15, 17,18,19].

Characteristics of studies

The characteristics of all studies are summarised in Table 1. Only acute traumatic injuries were included. Three studies prospectively recruited patients and two of these studies included patients with clinical suspicion of scaphoid fracture in whom the initial X-ray was negative. The third included all patients with a suspected scaphoid fracture [17]. Two studies retrospectively identified cases, one included all trauma to distal upper and lower limbs whilst the other included clinical suspicion of scaphoid fracture only, and all included patients underwent X-ray and CBCT at time of presentation [10, 26]. The mean age ranged from 33 to 49. The total number of patients included was 439, with 381 proven to have fractures by CBCT. For all studies, imaging was interpreted by at least one radiologist. In three studies, the radiologists were blinded to all previous imaging and the other radiologist’s report [15, 18, 19]. In the other two studies, the interpreting radiologist worked in consensus [10, 17]. Four of the studies also blinded the radiologist to the clinical information [10, 17,18,19]. In addition to a radiologist, an orthopaedic consultant also reviewed the images in two studies [10, 19]. One study used MRI as the reference standard for all patients [18]. The other four studies used radiographs and CBCT for all patients with follow-up clinical examination and additional imaging (MRI) used as the reference standard. Table 2 shows the characteristics of different imaging modalities used.

Table 1 Characteristics of all included studies
Table 2 Characteristics of different imaging modalities used by included studies

Methodological quality of included studies

The risk of bias analysis is summarised in Fig. 3a and b. Only one study used MRI for all patients as the reference standard [18]. The other four studies used clinical follow-ups with or without MRI as the reference standard. Differential reference bias can reduce the accuracy of the study findings. The majority of studies used blinded radiologists to interpret the imaging results; however, in Grunz et al. [10], the interpreting radiologists were aware of the original imaging results. Gibney et al. [15] categorized radiographically occult fractures based on initial radiology reports. They retrospectively found that if all such radiographs were reviewed by an experienced musculoskeletal radiologist, 17% of initially labelled ‘occult’ fractures would have been identified. However, there is limited feasibility of musculoskeletal radiologists reporting all acute injuries in the emergency setting [15]. Studies which used first-visit follow-up to select patients may be prone to selection bias as patients who had resolving pain may not have attended follow-up. The study by Edlund et al. [17] was subject to attrition bias with 15% of patients not undergoing scheduled follow-up MRI. Moreover, MRI was carried out 2 weeks after CBCT scans.

Fig. 3
figure 3

a The methodological quality assessment summary. b The methodological assessment for each individual study included

Findings

The forest plots for sensitivity and specificity for CBCT identifying radiocarpal fractures are displayed in Fig. 4 with a breakdown for scaphoid fractures and all carpal fractures individually.

Fig. 4
figure 4

The forest plots for sensitivity and specificity for CBCT identifying radiocarpal fractures

Scaphoid fractures

The sensitivity estimates for CBCT identification of scaphoid fractures ranged from 69 to 94%. The specificity estimates ranged from 96 to 100%. The pooled sensitivity was 87.7% (95% CI 77.6–93.6) and pooled specificity was 99.2% (95% CI 92.6–99.9), as shown in Fig. 5a. The DOR was 940.7 (95% CI 111.3–7951.8). The LR+ and LR− were 116.6 (95% CI 11.7–1157.8) and 0.12 (95% CI 0.06–0.23).

Fig. 5
figure 5

a The HSROC curves for CBCT when assessing diagnostic accuracy for scaphoid fractures. b The HSROC curves for CBCT when assessing diagnostic accuracy for radiocarpal fractures. c The HSROC curves for CBCT when assessing diagnostic accuracy for carpal bone fractures

Radiocarpal fractures

The sensitivity estimates for CBCT identification of all radiocarpal fractures ranged from 66 to 99%. The specificity estimates ranged from 94 to 100%. The pooled sensitivity was 93.5% (95% CI 81.1–98.0) and pooled specificity was 99.9% (95% CI 91.6–1.00), as shown in Fig. 5b. The DOR was 13,533.9 (95% CI 132.6–1,380,880). The LR+and LR−were 882.2 (95% CI 10.3–75,682.0) and 0.07 (95%CI 0.02–0.20).

Carpal fractures

The sensitivity estimates for CBCT identification of carpal fractures ranged from 68 to 98%. The specificity estimate ranged from 99 to 100%. The pooled sensitivity was 90.6% (95% CI 72.7–97.2) and pooled specificity was 100% (95% CI 99–100), as shown in Fig. 5c. The DOR was 24 287.4 (95% CI 635.0–928,866.7). The LR+ and LR− were 2280.0 (95% CI 73.4–7773.6) and 0.09 (95% CI 0.03–0.3).

Distal radius fractures

The sensitivity estimates for CBCT identification of distal radius fractures ranged from 65 to 100%. The specificity estimates were 100% in all papers. Reduced data availability limited hierarchical modelling as only 28 distal radius fractures were reported. Pooled values obtained through mixed effects modelling found a sensitivity of 90% (95% CI 67–98) and specificity of 100% (95% CI 10–100).

Inter-rater agreement meta-analysis

Kappa estimates ranged from 0.78 to 0.95. The overall effect for meta-analysis was 0.89 (95% CI 0.82–0.96), as shown in the forest plot in Fig. 6.

Fig. 6
figure 6

The forest plot of kappa values for reported inter-rater agreement observed in CBCT

Discussion

The use of flat-panel detectors to perform CBCT image acquisition has recently revolutionised the field of minimally invasive radio-diagnostics. It is increasingly being used for fractures of the extremities, allowing for multiplanar reconstruction. Although a recent metanalysis has been performed on the diagnostic accuracy of CBCT for scaphoid fractures, our study is the first to evaluate its use in acute carpal and distal radius fractures. An excellent diagnostic accuracy of CBCT (AUC 0.99) was seen for all reported radiocarpal fractures [10, 15, 17, 18], with 93.5% sensitivity and 99.9% specificity. Moreover, our results support the use of CBCT in the diagnosis of scaphoid fractures with a pooled sensitivity and specificity of 87% and 99%, respectively, and an overall AUC of 0.98.

Clinical examination in the diagnosis of scaphoid fracture has a wide range of sensitivity (15–100%) and specificity (13–98%). This substantial variation in diagnostic accuracy suggests clinical suspicion is a poor diagnostic indicator of scaphoid fracture if used in isolation [27]. Radiographs are the initial imaging modality of choice but display a relatively poor diagnostic accuracy with a sensitivity between 66 and 81% for scaphoid fractures, 39% for carpal fractures overall and 58% for wrist fractures. Carpal bones have a more complex geometry making them are harder to analyse compared to long bones on radiographs [18]. Radiographs also have a 20–54% false negative rate soon after injury and offer limited information even after 2–6 weeks post-injury. Moreover, it provides unreliable information about fracture alignment, with up to 30–50% of displaced scaphoid fractures missed [26, 28,29,30]. Thus, the diagnostic value of radiographs in the assessment of radiocarpal fractures is questionable given the varying sensitivity and specificity and poor inter-rater agreement reported by multiple studies [28].

Despite its novelty, there is a very slight difference in inter-rater agreement with CBCT use [18]. Four of the included studies reported substantial or almost perfect inter-rater agreement, as per Landis and Koch agreement scale [31], with excellent confidence as reported by Neubauer et al. [36]. Our analysis demonstrated an almost perfect agreement in the diagnosis of scaphoid fractures using CBCT, with a pooled kappa value of 0.89, irrespective of the radiologist’s experience. In contrast, inter-observer agreement has been shown to be poor for radiographs [24]. This limitation of radiographic assessment is corroborated in the study by Neubauer et al. [19] demonstrating a reduced confidence in reported findings based on radiographs.

In addition to detecting occult fractures, CBCT can aid surgical planning for scaphoid fractures. Grunz et al. [10] showed a change in the management plan for approximately a third of patients based on CBCT findings. Three undetected scaphoid fractures on radiographs underwent surgery based on CBCT findings, whilst five presumed carpal fractures on radiographs were ruled out by CBCT, which would have had unnecessary immobilisation. Similarly, Neubauer et al.’s [19] study reported CBCT imaging resulting in a 15% change in management, with 7% upgraded and 8% downgraded. These findings are comparable to Brink et al. [32] who investigated patients who underwent a single shot MDCT after radiography. In four studies, MRI was performed when there was ongoing clinical concern about occult carpal fractures, which detected additional scaphoid fractures missed on radiography and CBCT scanning [10, 15, 17, 19]. A potential reason for false negative results may be osteopenia, resulting in reduced trabecular and cortical bone thickness.

For scaphoid fractures, conventional computerized tomography (CT) has a sensitivity and specificity of 82% and 96% respectively. CBCT has a comparable diagnostic accuracy to MDCT but with additional benefits [11, 33]. It produces a more detailed image which allows greater visualisation of the area. Spatial resolution which indicates the scanner ability to depict fine detail is an important measure of image quality with regards to bone imaging [14]. CBCT produces sub-millimetre resolution ranging from 0.4 mm to as low as 0.09 mm, whilst standard CT has a spatial resolution of 1–2 mm [34]. Although, to date, no cost–benefit analysis has been performed radiocarpal fractures, Faccioli et al. [35] demonstrated that the introduction of CBCT compared to MDCT in the management of complex finger fractures reduces the time of diagnostic work-up and number of diagnostic procedures, improves quality of life and reduces costs. When trialled in the emergency radiology department, CBCT offered a feasible alternative to MDCT for detection of extremity fractures also increasing patient turnover and reducing radiation exposure [36].

Relative to the annual background radioactivity exposure of 2.4 mSv, and CT effective dose (ED) of 0.03 mSv, CBCT has a very low ED of 0.007 mSv [37]. Grunz et al. [10] used a lower dose for scanning compared to existing literature, with an ED of 4.3 microSv (3.3–5.3), whilst Gibney et al. [15] reported the use of 0.5–1.4 microSv. In comparison, the combined ED for conventional radiography in the assessment for scaphoid injuries has been shown to be up to 2 microSv [38]. Inferentially, CBCT may be performed with an almost comparable ED to radiographs and has an up to 90% lower radiation compared to conventional CT scans [25]. Additionally, it enables the use of lead shielding which is an easy and effective method for further reducing patient exposure to radiation [39]. Lastly, it can be performed with similar positioning of patients for X-ray and thus can be incorporated into a ‘one-stop-shop’ imaging in acute trauma of the extremities [10].

MRI remains the gold standard for wrist fracture diagnoses with a higher sensitivity than CBCT. Nevertheless, our study supports the implementation of CBCT as a reliable examination for the diagnosis of radiocarpal bone fractures, reducing the MRI burden on radiology departments. Diagnosing fractures earlier potentially reduces unnecessary immobilisation, improving cost-effectiveness and reducing patient morbidity.

One of the limitations of CBCT is image acquisition time. The included studies had an acquisition time range of 15–36 s [10, 15, 17,18,19]. Due to potential positional instability, there is an increased risk of motion artefacts [19]. Whilst Borel et al. [18] suggested stabilisation with straps, Grunz et al. [10] observed no motion artefact in 72.8% of patients with a dedicated extremity machine, and a significantly lower proportion in upper limb extremities compared to lower limb [40]. On the other hand, MRI has a considerably longer acquisition time with image post-processing susceptible to movement artefacts [41].

Additionally, CBCT has been shown to be less effective in diagnosing trabecular bone fractures compared to cortical bone fractures, as it cannot detect soft tissue and bony changes related to such injuries [2]. Nonetheless, trabecular fractures are less common and the clinical implication of this is uncertain as there is no clear consensus on their management [14]. Moreover, CBCT has a limited correlation of bone density with Hounsfield units which may augment image artefacts due to metal implants [12]. Lastly, CBCT has a limited field of vision (FoV) which makes it unsuitable for shoulder and hip fracture assessments, and hence is limited to use in extremities only.

There are several limitations to this meta-analysis. The studies included varying imaging protocols and had a lack of a uniform reference standard. Our studies assumed fractures detected on CBCT to be accurate. Moreover, most studies included patients with ongoing clinical suspicion of scaphoid fractures with negative initial radiography, which may affect the true representativeness of the study population thus limiting the conclusions drawn in this review. Only studies in English were included which may introduce further selection bias. Two of the studies included only occult scaphoid fractures. As occult fractures are more diagnostically challenging, the overall sensitivity and specificity of CBCT might be higher than reported in this study. Given the small number of studies in our review, we were unable to estimate heterogeneity. The use of CBCT for distal upper limb fracture diagnosis is a new initiative and many centres do not have access to CBCT. Further studies with a more robust methodology are required to implement CBCT as a low-dose diagnostic modality for upper limb extremity fractures.

Our study has shown that CBCT is superior to radiographs for radiocarpal cortical fractures. Despite its relatively longer acquisition time, CBCT may be helpful in the diagnostic algorithm as a replacement or supplement (depending on resources available) to radiographs and may improve cost-effectiveness when used in the acute setting. With minimal exposure to radiation, it can obviate the need for unnecessary immobilisation and reduce the burden on the number of follow-up MRI scans required.