Abstract
Objectives
To develop and validate an artificial intelligence (AI) system for measuring and detecting signs of carpal instability on conventional radiographs.
Materials and methods
Two case-control datasets of hand and wrist radiographs were retrospectively acquired at three hospitals (hospitals A, B, and C). Dataset 1 (2178 radiographs from 1993 patients, hospitals A and B, 2018–2019) was used for developing an AI system for measuring scapholunate (SL) joint distances, SL and capitolunate (CL) angles, and carpal arc interruptions. Dataset 2 (481 radiographs from 217 patients, hospital C, 2017–2021) was used for testing, and with a subsample (174 radiographs from 87 patients), an observer study was conducted to compare its performance to five clinicians. Evaluation metrics included mean absolute error (MAE), sensitivity, and specificity.
Results
Dataset 2 included 258 SL distances, 189 SL angles, 191 CL angles, and 217 carpal arc labels obtained from 217 patients (mean age, 51 years ± 23 [standard deviation]; 133 women). The MAE in measuring SL distances, SL angles, and CL angles was respectively 0.65 mm (95%CI: 0.59, 0.72), 7.9 degrees (95%CI: 7.0, 8.9), and 5.9 degrees (95%CI: 5.2, 6.6). The sensitivity and specificity for detecting arc interruptions were 83% (95%CI: 74, 91) and 64% (95%CI: 56, 71). The measurements were largely comparable to those of the clinicians, while arc interruption detections were more accurate than those of most clinicians.
Conclusion
This study demonstrates that a newly developed automated AI system accurately measures and detects signs of carpal instability on conventional radiographs.
Clinical relevance statement
This system has the potential to improve detections of carpal arc interruptions and could be a promising tool for supporting clinicians in detecting carpal instability.
Key Points
-
Artificial intelligence can accurately measure and detect signs of carpal instability on conventional radiographs.
-
It measures scapholunate distances, scapholunate and capitolunate angles, and detects carpal arc interruptions. The measurement accuracy was largely comparable to five clinicians with different specialties, and the arc interruption detections were more accurate than most clinicians.
-
All measurements and detections are explainable, and a new heat map technique was developed for visualizing the degree and location of carpal arc interruptions in the image.
Graphical Abstract
![](http://media.springernature.com/lw685/springer-static/image/art%3A10.1007%2Fs00330-024-10744-1/MediaObjects/330_2024_10744_Figa_HTML.png)
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Carpal instability exists when the carpal bones cannot maintain their normal alignment under physiologic loads and movements [1]. Most forms of carpal instability are caused by acute trauma, such as ligament ruptures and displaced fractures. Nontraumatic causes are less common and include inflammatory arthritis, infections, and congenital disorders. While the true prevalence of carpal instability remains unknown, traumatic ligament injuries have been found to frequently co-occur with acute wrist fractures. In studies using surgically verified data (i.e., wrist arthroscopy), they were reported to be present in 34% of all scaphoid fractures [2] and 13–64% of all distal radius fractures [3,4,5]. Scapholunate (SL) ligament tears were commonly identified in both types of fractures. It is important to identify these injuries at an early stage, as they could lead to SL dissociation and SL advanced collapse (SLAC) if untreated [6]. It has been reported that signs of carpal instability co-occurring with acute wrist fractures are frequently overlooked on conventional radiographs [7,8,9]. As conventional radiography is usually the first imaging modality of choice after suspected wrist trauma [10], it can be worthwhile to focus research efforts on detecting signs of carpal instability on conventional radiographs.
To identify carpal instability on conventional radiography, it is recommended to evaluate for widened intercarpal joint distances and abnormal carpal angles [1, 11]. Widening of the SL joint can be indicative of traumatic tears of the SL ligament. In addition, disruptions of the carpal arc alignment are useful radiological features for identifying this condition and other causes of carpal instability [12]. However, carpal measurements have been shown to be subject to human variation and error [13,14,15] and may be unfamiliar to clinicians other than musculoskeletal (MSK) radiologists and (hand) surgeons. Therefore, a reliable and automated system to measure and detect signs of carpal stability could prove to be a valuable tool in daily clinical practice.
In recent years, artificial intelligence (AI) software has shown high performance in automating various tasks in the field of musculoskeletal radiology [16,17,18,19]. These tasks range from quantifications, such as bone age assessments and body composition measurements, to lesion detections, such as bone fractures and tumors. In light of these advances, we propose an explainable and unified framework for automatically measuring and detecting a wide variety of carpal instabilities. To limit the scope of the study, we demonstrate the value of this framework for assessments of the SL joint distance, SL and capitolunate (CL) angle, and carpal alignment. The purpose of this study was twofold: (a) to develop and validate an AI system that can accurately measure and detect signs of carpal instability; and (b) to assess how this system compares to clinicians with various specialties in measuring and detecting signs of carpal instability on conventional radiographs.
Materials and Methods
Datasets
This retrospective study was approved by the local institutional boards of the Radboud University Medical Center (Radboudumc), Jeroen Bosch Hospital (JBZ), and Hospital Gelderse Vallei (ZGV) in The Netherlands. Informed written consent was waived, and data collection, anonymization, and storage were performed in accordance with local guidelines. Two datasets of hand, wrist, and scaphoid radiographs were prepared for training and evaluating the AI system. An overview of the characteristics of these datasets is provided in Table 1. Additional imaging parameters are provided in Appendix E1 (online).
Dataset 1
Dataset 1 consisted of 2178 radiographs (1993 patients) that were obtained at Radboudumc and JBZ in 2018–2019. It consisted of an equal portion of frontal view (including neutral, ulnar-deviated, clenched fist anterior-posterior [AP] or posterior-anterior [PA], and oblique) and lateral view radiographs. Radiographs were excluded when the outlines of the carpal bones could not be delineated due to metal implants and casts or excessive degeneration, fusion, or destruction of bones. The latter conditions can occur due to high-energy trauma or chronic disease, such as end-stage rheumatoid arthritis. The annotation protocol and a flow chart of the training data selection (dataset 1) are respectively provided in Appendices E2 and E3 (online).
Dataset 2
Dataset 2 consisted of 481 radiographs (217 patients; one study per patient) obtained at ZGV in 2017–2021. This dataset served for evaluating the automated measurements of the AI system. The studies were preselected based on the original radiology reports to balance the number of patients with and without signs of carpal instability. A flow chart of the test data selection (dataset 2) is shown in Fig. 1. Stricter exclusion criteria were applied as compared to dataset 1 by excluding radiographs with (a) any overprojection caused by metal implants and casts, (b) no neutral (relaxed) lateral wrist position, (c) non or partially ossified and developed carpus (in children). The first criterion was added to maximize the reliability of the measurements. The latter two criteria were minimally required for performing the measurements (see “Measurement Definitions” section). The annotation protocol is described in the section “Reference Standard”.
Flowchart for the inclusion and exclusion of studies in dataset 2 (test set). The number of studies at each step is denoted with n. Studies were preselected from the text search results in random order. aBased on the study metadata (e.g., study date, patient demographics, report), these studies were found to be duplicates of studies that were already included
A subset of dataset 2 was used for conducting the subsequent observer study (see “Observer study” section). It consisted of 87 studies (193 radiographs from 87 patients). The subset was balanced by including at least 20 studies for each of the following conditions: abnormal CL angle, abnormal SL angle, abnormal SL joint distance, interrupted carpal arcs, and no abnormal measurements. The distribution of distance and angle measurement values for dataset 2 (full and subset) is provided in Appendix E4.
Measurement definitions
The measurements investigated in this study were defined according to the literature [20]. The SL joint distance was measured on the mid-points of the scaphoid-lunate facet on the AP/PA view. Dornberger et al [21] showed that thresholds of 3.0 and 3.7 mm on respectively neutral and ulnar-deviated views (Stecher’s projections) were optimal. SL joint distances exceeding these thresholds were considered abnormal in this study. For children (6–14 years old), the thresholds were set to the upper limit of the normal values per age group, as reported by Kaawach et al [22].
The SL and CL angles were defined as the angles between the long axis of the scaphoid or capitate and the mid-plane axis of the lunate on the lateral radiographic view [11]. In a neutral wrist position, the SL angle should be between 30 and 60 degrees, and the CL angle should be less than 30 degrees. Values exceeding these reference values were considered abnormal. The same thresholds were used for children and adolescents.
The carpal arcs were defined on the neutral AP/PA view as proposed by Gilula [12]. The arcs were considered interrupted or abnormal in cases of carpal dislocations, carpal collapses, or dislocated carpal fractures. Dissociations causing the arcs only to lengthen were not considered interruptions unless bones subluxated proximally into the widened joint spaces. This also applied to normal anatomical variants (i.e., shortened triquetrum or bi-lobed/type II lunate morphology [23]) or narrowed joint spaces.
Reference standard
The reference standard was determined by a consensus reading of two experienced MSK radiologists (M.R. and B.M., with 27 and 26 years of experience, respectively). They independently annotated the test dataset (dataset 2) and resolved any discrepancies using the consensus reading procedure as described in Appendix E5 (online).
AI pipeline
The pipeline of the AI system is summarized in Fig. 2. The system was designed to take a radiograph as input and to return the following outputs (depending on the provided view): (a) SL joint distance in millimeters, (b) SL angle in degrees, (c) CL angle in degrees, (d) polylines of the carpal arcs, and (e) markers of potential disruptions of the carpal arcs with an overall disruption score. The pipeline consisted of three general steps. Two convolutional neural networks (CNNs) first segmented the anterior and lateral sides of the carpals on the AP/PA view and lateral view, respectively. Next, the orientation (major/minor axis) and articular facet joint surfaces of the bones were determined using active appearance models (AAMs). Last, all measurements and subsequent detections from the articular surfaces and bone axes were automatically derived by the AI system. Interruptions of the carpal arcs were determined by comparing the observed and reconstructed hypothetical shape of the carpal arc polylines if noninterrupted (obtained from a point distribution model [PDM]). A newly developed heat map technique using vectors and color-coding visualizes the degree (z-score) and location of carpal arc interruptions in the original image (Fig. 2). The system is publicly available at https://grand-challenge.org/algorithms/, where it can be run in a web browser. A detailed description of the processing steps and training procedure is provided in Appendices E6 and E7 (online).
Overview of the (AI) pipeline for measuring and detecting signs of carpal instability in frontal and lateral view radiographs. The spatial and geometric properties of the relevant carpal bones are determined by segmentation and are then used to identify the articular facet joint surfaces. Based on the obtained bone surfaces and angles, the carpal instability measurements and detections can be conducted. The generated carpal arcs are visualized as color-coded points (n = 100) that form an easily interpretable heatmap. The warmer colors indicate significant deviations from the reconstructed hypothetical normal arcs (expressed as z-scores). These deviations or distances are shown by the small tails attached to the points (displacement vectors). More information can be found in Appendix E6 (online)
Observer study
An observer study was conducted among five clinicians: an MSK radiologist (M.V.), non-MSK radiologist (S.K.), hand surgeon (S.Z., EBHS certified), junior doctor on general surgery (J.v.A.), and emergency (ER) doctor (T.O.-B.) with 14, 12, 16, 1, and 24 years of experience, respectively. The clinicians independently measured in the subset of database 2 the SL joint distance, SL and CL angle (derived from axes) as defined in the “Measurement Definitions” section. They indicated their confidence on a five-point Likert scale whether the carpal arcs were interrupted. The lowest and highest scores, respectively, indicated that the carpal arcs were definitely normal and abnormal, while the neutral option (uncertain, interruptions might be present or not present) was the cut-off point for the clinical decision for follow-up examination. The clinicians assessed all cases using the Cirrus Core Workstation on the web platform Grand Challenge (version 2022.07, 2022) [24] and had access to all radiographic views per patient.
Statistical analysis
Evaluation metrics
The segmentation and landmark localization component of the AI system were separately evaluated on dataset 1. The evaluation details are provided in Appendix E8 (online). The whole AI system was evaluated on dataset 2. The accuracy of the measurements and generated carpal arcs were respectively evaluated using the mean absolute error (MAE) and mean Fréchet distance (MFD). The measurement agreement with the reference standard was evaluated using the bias and limits of agreement (LoA) obtained from a Bland-Altman plot analysis [25]. The ability to detect abnormal distances, angles, and carpal arc interruptions was evaluated using the following metrics: sensitivity, specificity, and area under the receiver operating characteristic (ROC) curve (AUC) (arc interruptions only). For evaluating carpal arc interruption detections, the detection threshold of the AI system was selected that maximized the Youden’s index. The Fréchet distance was calculated using the similarity measures Python library (version 0.7.0, 2023) [26]. The Bland-Altman plot analysis was conducted using the pyCompare Python library (version 1.5.4, 2022) [27]. The other metrics were calculated using the scikit-learn Python library (version 1.2.1, 2023) [28].
Significance tests
Stratified bootstrapping with 1000 iterations was applied for estimating 95% confidence intervals (CIs), except for the Bland-Altman plots that were calculated as described in [25]. Stratification was conducted by grouping data per 1 mm (distances), 10 degrees (angles), and binary labels (detections). Significance testing was performed with two-sided paired permutation tests with 1000 iterations using the MLxtend Python library (version 0.21.0, 2022) [29], except for the AUCs that were compared with DeLong tests [30] using the pyroc Python library (version 0.2.0, 2022) [31]. Differences with a p value smaller than 0.05 were considered significant.
Results
Test data characteristics
Five hundred and seventy-four studies with and without signs of carpal instability were preselected based on the radiology reports. After the initial visual assessment, 196 studies were excluded. These studies involved the following cases: wrist in cast and/or with osteosynthesis material (n = 111), both hands depicted in a single radiograph (n = 61), carpal bones not fully depicted (n = 10), too severe degeneration or destruction of the carpal bones (n = 8), too young patient (≤ 6 years old; n = 6). Cases with severe degeneration or destruction (e.g., SLAC, displaced fractures) were only excluded when the annotation was no longer possible due to disappeared articular surfaces (n = 6), excessive osteoporosis (n = 1), or complete isolated scaphoid dislocation (n = 1).
Next, from the 220 studies randomly sampled for the consensus reading procedure, two duplicate studies and one study examining a patient with insufficient ossification of the carpal bones were excluded. Three SL distance and SL angle measurements were respectively excluded due to insufficient visibility of the anterior side of the lunate and the lateral side of the scaphoid. This resulted into a final selection of 217 studies from 217 patients (mean age, 51 years ± 23 [standard deviation {SD}]; 133 women). As the studies contained multiple radiographic series, the measurements included 258 SL distances, 189 SL angles, 191 CL angles, and 217 sets of labelled carpal arcs. All studies selected for the observer study (subset of dataset 2) contained at least one AP/PA and lateral view radiograph (no excluded measurements), so that all measurements could be conducted by the clinicians.
Evaluation of the AI system
Measurement and detection results
Table 2 presents the measurement error (MAE, bias, LoA, MFD) of the AI system for SL joint distances, SL and CL angles, and carpal arcs with their 95% CIs in dataset 2. The MAEs in measuring the SL joint distance, SL angle, and CL angle on the total dataset were 0.65 mm, 7.9 degrees, and 5.9 degrees, respectively. The corresponding Bland-Altman plots are shown in Fig. 3, and the detection results are included in Appendix E9. The MFDs in measuring the proximal, middle, and distal carpal arc on the total dataset were 1.34, 1.15, and 1.25 mm, respectively. The sensitivity, specificity, and AUC in detecting interruptions in the carpal arcs were 83% (95%CI: 74%, 91%), 64% (95%CI: 56%, 71%), and 0.80 (95%CI: 0.73, 0.87), respectively (detection threshold was set to 11%). The corresponding ROC curve with 95%CI bands is shown in Fig. 4a.
Bland-Altman plots of the measurement agreement between the AI system and the GT on the measurements of the SL distance (n = 258, see a), SL angle (n = 189, see b), and CL angle (n = 191, see c) in dataset 2. Each marker represents one paired measurement. The dashed lines represent the mean difference (blue) and LoA (orange). The shaded bands represent 95%CI
a ROC curve with the operating point of the carpal arc interruption detection results of the AI system on dataset 2 (70 positive cases, 147 negative cases). b ROC curves of the carpal arc interruption detection results of the AI system and those of the clinicians on the observer study subset (44 positive cases, 43 negative cases). Each case represents one study from one patient. The shaded bands represent 95%CIs. The black line represents no ability to discriminate between interrupted and non-interrupted arcs. AUC = area under the ROC curve
Results of auxiliary system components
The carpal bone segmentation and landmark localization results are included in Appendices E10 and E11 (online).
Comparison of the AI system to the clinicians
Measurement and detection results
Table 3 presents the measurement error (MAE, bias, LoA) of the AI system and clinicians for SL joint distances, SL and CL angles with their 95%CIs and p values. The corresponding Bland-Altman plots are provided in Appendix E12. Table 4 presents the detection performance (sensitivity, specificity, AUC) of the AI system and clinicians for interrupted carpal arcs with their 95%CIs and p values. The ROC curves for the carpal arc interruption detections are shown in Fig. 4b.
Failure case analysis
A qualitative analysis of the failure cases of the AI system and clinicians showed that the AI system made 13 measurement and subsequent detection errors that none of the clinicians made (from a total of 52 errors [AI]: 4/12 [SL distance], 5/16 [SL angle], 3/8 [CL angle], 1/16 [carpal arcs]). Example failure cases corresponding to the SL distances, SL and CL angles are shown in Fig. 5, and those corresponding to the carpal arcs are shown in Fig. 6. In four abnormal SL distance detection errors (false negatives), the segmentation of the scaphoid or lunate was elongated into the widened SL joint space (n = 2) or the measurement was carried out on the nonanterior side of the lunate (n = 2). In the former failure cases, displaced fracture parts of the distal radius moved into the SL joint space. In five abnormal SL angle detection errors (four false positives, one false negative), the lunate axis significantly deviated due to prediction errors of the midpoint on the lunate-radius facet. In the three CL angle detection errors (two false positives, one false negative), the lunate axis (n = 3) and capitate axis (n = 2) significantly deviated due to prediction errors of the midpoint on the lunate-radius, lunate-capitate, or capitate-metacarpal III facet. In the abnormal angle detection failure cases, the lunate was either significantly rounded or fractured (with displacement), or there was substantial overprojection on the lunate and capitate (from the other bones). In one carpal arc interruption detection error (false positive), the proximal carpal arc had a nonrelevant interruption, as the proximal contour of the lunate diverged from the radius, and the scaphoid was slightly tilted.
Example measurement and subsequent detection errors of abnormal SL joint distances, SL angles, and CL angles made by the AI system and clinicians. The lines in yellow, cyan, and orange, respectively, represent the AI, clinicians, and GT measurements. The axes of the angle measurements are shown in white with a dense pattern (AI or clinicians) and a dashed pattern (GT). The start and end coordinates of the lines corresponding to clinicians and GT have been averaged for this figure. The measurement value and corresponding GT are provided below each panel. a 77-year-old male with a widened SL joint distance (> 3 mm). b 37-year-old male with a normal SL joint distance. c 36-year-old male female with a normal SL angle. d 37-year-old male with a normal CL angle. e 74-year-old female with a normal SL angle. f 68-year-old female with an abnormal CL angle (> 30 degrees)
Example detection errors of carpal arc interruptions made by the AI system (a) and clinicians (b and c). The AI prediction and GT label are shown in the upper left corner of each image. The interruption scores of the clinicians are shown below each image (ranging from 0% [no interruption] to 100% [interruption]). The carpal arcs generated by the AI system are overlaid as color-coded points on the original image. The points correspond to z-scores: the higher the z-score, the more abnormal and hence indicative the point is of an interruption (see more information in Appendix E6 [online]). The deviations from the hypothetical normal shape of the carpal arcs are shown by the small tails attached to the points (displacement vectors). a 53-year-old female with a distal radius fracture and slight narrowing of the radiocarpal joint but normal carpal alignment. b 82-year-old male with the capitate subluxating proximally into the direction of a widened SL joint space. c 26-year-old male with slight angulation of the lunate accompanied by a widened SL joint space and semiacute scaphoid fracture. ER Doc = emergency doctor, H Surg = hand surgeon, Jr Doc = junior doctor, MSK Rad = musculoskeletal radiologist, Rad = radiologist
There were 20 measurement and subsequent detection errors made by the majority of clinicians that were not made by the AI system (from a total of 52 errors [clinicians]: 3/8 [SL distance], 6/16 [SL angle], 2/5 [CL angle], 9/23 [carpal arcs]). Example failure cases corresponding to the SL distances, SL and CL angles are shown in Fig. 5, and those corresponding to the carpal arcs are shown in Fig. 6. In three widened SL distance detection errors (false positives), the clinicians disagreed on the location of the anterior side of the lunate (due to pseudo-delineated or irregular contour) (n = 2) or scaphoid (due to pseudo-overarching surface) (n = 1). In six abnormal SL angle detection errors (three false positives, three false negatives), the scaphoid axis deviated due to overprojection on the dorsal side, especially from the triquetrum. In two abnormal CL angle detection errors (one false positive, one false negative), the capitate axis deviated due to an asymmetrical bone shape. In nine carpal arc interruption detection errors (one false positive, eight false negatives), the capitate and lunate respectively slightly subluxated proximally toward the widened SL joint space (n = 5) and radial carpal joint (n = 3), or the clinicians disagreed on the congruence of the articular surfaces between the lunate and its surrounding bones (n = 1).
Discussion
Measurements for carpal instability on conventional radiographs can be inconsistent between examiners and may be unfamiliar to less experienced clinicians. This multicenter study shows that AI driven measurements and detections of radiological signs of carpal instability are feasible at a clinically acceptable level. The MAEs in measuring SL distances, SL angles, and CL angles were 0.65 mm, 7.9 degrees, and 5.9 degrees, respectively. The sensitivity and specificity for detecting arc interruptions were 83 and 64%, respectively. The observer study shows that the AI system had a comparable accuracy to most clinicians in measuring SL distances and SL angles (equal or higher [p < 0.05] than, respectively, four and five clinicians). It had a lower accuracy in measuring the CL angle than most clinicians (p < 0.05 for three clinicians), but the difference was slight (MAE, 6.0 vs. 4.0 degrees [clinician average]). The AI system had a higher sensitivity than three clinicians at equal specificity in detecting carpal arc interruptions (sensitivity/specificity, 73%/91% vs. 45%/95% [clinician average], p < 0.05 [sensitivity] and p ≥ 0.05 [specificity]). To the best of our knowledge, only Keller et al [32] have investigated the application of AI for one of the tasks and also demonstrated that SL distance measurements can be accurately automated. Based on our findings, we expect that AI can potentially improve detections of signs of carpal instability and enable efficient screening without additional workload for clinicians.
The failure case analysis revealed that there were qualitative differences between the AI system and clinicians. It was found that 25% (13/52) of the detection errors of the system were not made by any clinician. However, conversely, the system did not make 38% (20/52) of the detection errors made by the majority of clinicians. Compared to the clinicians, the system displayed a slight disadvantage in measuring CL angles and carrying out measurements in patients with a displaced wrist fracture. Given the co-occurrence of ligament injuries with acute wrist fractures, this is a relevant finding that should be addressed in future research. Nevertheless, it did not result in a lower detection performance overall.
The AI system displayed an advantage over the clinicians in determining the scaphoid axis when overprojection was present and in detecting subtle arc interruptions due to subluxations. In this regard, there was no distinct difference between clinicians who could be considered more specialized (i.e., MSK radiologist, hand surgeon) and less specialized (i.e., junior doctor, ER doctor) in assessing carpal instability. This suggests that the system may have merit for both kinds of clinicians in these cases. However, it is important to note that generally the more specialized clinicians tended to have a lower measurement and detection error than the less specialized clinicians. Furthermore, while the system had a higher sensitivity for arc interruptions than the ER doctor, non-MSK radiologist, and hand surgeon, the difference in AUC was only significant for the ER doctor. This indicates that the confidence scores of the hand surgeon and radiologist were on the conservative side (i.e., the optimal threshold was lower than the neutral point on the Likert scale). For those clinicians, the system could potentially be beneficial in confirming suspicions of interrupted carpal arcs. Follow-up research with more clinicians per profession is required to confirm our findings.
This study had several limitations. First, the studies in the test dataset were collected in a case-control manner and were mainly (pre)selected based on the original radiology reports. Radiology reports were used for the selection due to the absence of reliable and specific diagnosis codes in the electronic health record (EHR) system. Subtle signs of carpal instability may not always have been reported, and this could have introduced selection bias, although we found that the test dataset contained a sufficient variety of measurement values. Second, cases with osteosynthesis material (e.g., metal plates, screws, k-wires) and casts were excluded in the test dataset to maximize the reliability of the measurements. We expect that this does not significantly affect the software performance as long as the joint spaces and surfaces are freely projected, but this should be investigated in future research. Third, we only focused on assessing the accuracy of the automated measurements and did not link the derived detections of carpal instability signs to the diagnosis. Carpal instability can be diagnosed with wrist arthroscopy or alternatively with MRI and CT arthrography. Nonetheless, assessing the diagnostic value of the measurements was beyond the scope of this study and should be addressed at a later stage of development. Last, the software was compared against a panel of clinicians with different professions, as the diagnosis and treatment of carpal instability often involves a multidisciplinary approach. Although this comparison provided an estimate of the performance across clinicians, the heterogeneity of the panel also meant that no universal performance could be extracted.
In conclusion, this study provides preliminary evidence that an automated AI system can accurately measure and detect radiological signs of carpal instability. The automated measurements and detections were found to be largely comparable to those of clinicians and may help to raise awareness of carpal instability in clinical practice. The system displayed the potential in improving the detections of carpal arc interruptions by both specialized and less specialized clinicians. The proposed framework could be useful for automating other carpal instability measurements and measurements in other musculoskeletal structures. Future research should validate the AI system in an observer study with more clinicians per profession and investigate its potential impact on patient outcomes in a concurrent reading setting.
Abbreviations
- AI:
-
Artificial intelligence
- AP:
-
Anterior-posterior
- CL:
-
Capitolunate
- LoA:
-
Limits of agreement
- MAE:
-
Mean absolute error
- MFD:
-
Mean Fréchet distance
- MSK:
-
Musculoskeletal
- PA:
-
Posterior-anterior
- SL:
-
Scapholunate
References
Lee DJ, Elfar JC (2015) Carpal ligament injuries, pathomechanics, and classification. Hand Clin 31:389. https://doi.org/10.1016/J.HCL.2015.04.011
Wong TC, Yip TH, Wu WC (2005) Carpal ligament injuries with acute scaphoid fractures - a combined wrist injury. J Hand Surg Br 30:415–418. https://doi.org/10.1016/J.JHSB.2005.02.011
Forward DP, Lindau TR, Melsom DS (2007) Intercarpal ligament injuries associated with fractures of the distal part of the radius. J Bone Joint Surg Am 89:2334–2340. https://doi.org/10.2106/JBJS.F.01537
Lindau T, Arner M, Hagberg L (1997) Intraarticular lesions in distal fractures of the radius in young adults. A descriptive arthroscopic study in 50 patients. J Hand Surg Br 22:638–643. https://doi.org/10.1016/S0266-7681(97)80364-6
Richards RS, Bennett JD, Roth JH, Milne KJ (1997) Arthroscopic diagnosis of intra-articular soft tissue injuries associated with distal radial fractures. J Hand Surg Am 22:772–776. https://doi.org/10.1016/S0363-5023(97)80068-8
Lane R, Tafti D, Varacallo M (2022) Scapholunate advanced collapse [Updated 2022 Sep 7]. StatPearls Publishing, Treasure Island, Florida, USA. Available via https://www.ncbi.nlm.nih.gov/books/NBK537124/. Accessed 3 Nov 2023.
Tiel-van Buul MMC, Bos KE, Dijkstra PF, van Beek EJR, Broekhuizen AH (1993) Carpal instability, the missed diagnosis in patients with clinically suspected scaphoid fracture. Injury 24:257–262. https://doi.org/10.1016/0020-1383(93)90182-6
Shahabpour M, Abid W, Van Overstraeten L, De Maeseneer M (2021) Wrist trauma: more than bones. J Belg Soc Radiol 105:90. https://doi.org/10.5334/JBSR.2709
Bunker DLJ, Pappas G, Moradi P, Dowd MB (2012) Radiographic signs of static carpal instability with distal end radius fractures: Is current treatment adequate? Hand Surg 17:325–330. https://doi.org/10.1142/S0218810412500256
Flores DV, Umpire DF, Gómez CM, Saad T, Cerezal L, Pathria MN (2021) Carpal instability: anatomy, kinematics, imaging, and classification. Radiographics 41:E155–E156. https://doi.org/10.1148/RG.2021210044
Goldfarb CA, Yin Y, Gilula LA, Fisher AJ, Boyer MI (2001) Wrist fractures: What the clinician wants to know. Radiology 219:11–28. https://doi.org/10.1148/radiology.219.1.r01ap1311
Gilula LA (1979) Carpal injuries: analytic approach and case exercises. AJR Am J Roentgenol 133:503–517. https://doi.org/10.2214/AJR.133.3.503
Becker J, Luria S, Huang S, Petchprapa C, Wollstein R (2022) Wrist angle measurements in predicting the presence of a displaced scaphoid fracture. Eur J Orthop Surg Traumatol 33:2271–2276. https://doi.org/10.1007/s00590-022-03418-5
Taillac H, Holzgrefe R, Hao KA et al (2023) Intercarpal angles on hand versus wrist films: Are hand radiographs sufficient for assessing intercarpal angles? J Hand Surg Am S0363–S5023. https://doi.org/10.1016/J.JHSA.2023.04.012
Said J, Baker K, Fernandez L, Komatsu DE, Gould E, Hurst LC (2018) The optimal location to measure scapholunate diastasis on screening radiographs. Hand (NY) 13:671. https://doi.org/10.1177/1558944717729219
Mutasa S, Paul HY (2021) Clinical artificial intelligence applications: musculoskeletal. Radiol Clin North Am 59:1013–1026. https://doi.org/10.1016/j.rcl.2021.07.011
Gorelik N, Gyftopoulos S (2021) Applications of artificial intelligence in musculoskeletal imaging: from the request to the report. Can Assoc Radiol J 72:45–59. https://doi.org/10.1177/0846537120947148
Burns JE, Yao J, Summers RM (2020) Artificial intelligence in musculoskeletal imaging: a paradigm shift. J Bone Miner Res 35:28–35. https://doi.org/10.1002/jbmr.3849
Guermazi A, Omoumi P, Tordjman M et al (2024) How AI may transform musculoskeletal imaging. Radiology 310:e230764. https://doi.org/10.1148/radiol.230764
Schimmerl-Metz SM, Metz VM, Totterman SMS, Mann FA, Gilula LA (1999) Radiologic measurement of the scapholunate joint: Implications of biologic variation in scapholunate joint morphology. J Hand Surg Am 24:1237–1244. https://doi.org/10.1053/jhsu.1999.1237
Dornberger JE, Rademacher G, Mutze S, Eisenschenk A, Stengel D (2015) Accuracy of simple plain radiographic signs and measures to diagnose acute scapholunate ligament injuries of the wrist. Eur Radiol 25:3488–3498. https://doi.org/10.1007/s00330-015-3776-2
Kaawach W, Ecklund K, Di Canzio J, Zurakowski D, Waters PM (2001) Normal ranges of scapholunate distance in children 6 to 14 years old. J Pediatr Orthop 21:464–467. https://doi.org/10.1097/01241398-200107000-00010
Viegas SF, Wagner K, Patterson R, Peterson P (1990) Medial (hamate) facet of the lunate. J Hand Surg Am 15:564–571. https://doi.org/10.1016/S0363-5023(09)90016-8
Meakin J, Gerke PK, Kerkstra S et al (2021) Grand-Challenge.org. Zenodo. https://doi.org/10.5281/ZENODO.6819122
Bland JM, Altman DG (1999) Measuring agreement in method comparison studies. Stat Methods Med Res 8:135–160. https://doi.org/10.1177/096228029900800204
Jekel CF, Venter G, Venter MP, Stander N, Haftka RT (2019) Similarity measures for identifying material parameters from hysteresis loops using inverse analysis. Int J Mater Form 12:355–378. https://doi.org/10.1007/s12289-018-1421-8
Pearce JTM, Tirrell L (2021) jaketmp/pyCompare v1.5.2. Zenodo. https://doi.org/10.5281/zenodo.4926654
Pedregosa F, Varoquaux G, Gramfort A et al (2011) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825–2830. https://doi.org/10.48550/arXiv.1201.0490
Raschka S (2018) MLxtend: providing machine learning and data science utilities and extensions to Python’s scientific computing stack. J Open Source Softw 3:638. https://doi.org/10.21105/joss.00638
DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics 44:837. https://doi.org/10.2307/2531595
Johnson A, Bulgarelli L, Pollard T (2022) alistairewj/pyroc: pyroc v0.2.0. Zenodo. https://doi.org/10.5281/ZENODO.6819206.
Keller G, Rachunek K, Springer F, Kraus M (2023) Evaluation of a newly designed deep learning-based algorithm for automated assessment of scapholunate distance in wrist radiography as a surrogate parameter for scapholunate ligament rupture and the correlation with arthroscopy. Radiol Med 1–7. https://doi.org/10.1007/s11547-023-01720-8
Acknowledgements
We would like to acknowledge the resources provided by the Radboud University Medical Center, Jeroen Bosch Hospital, and Hospital Gelderse Vallei for conducting this study. We also thank Ronald Brouwer for his assistance in data management.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Guarantor
The scientific guarantor of this publication is Matthieu Rutten.
Conflict of interest
The authors of this manuscript declare no relationships with any companies, whose products or services may be related to the subject matter of the article.
Statistics and biometry
One of the authors has significant statistical expertise.
Informed consent
Written informed consent was waived by the Institutional Review Board.
Ethical approval
This retrospective study was approved by the local institutional boards of the Radboud University Medical Center (Radboudumc), Jeroen Bosch Hospital (JBZ), and Hospital Gelderse Vallei (ZGV) in the Netherlands. An accredited medical research ethics committee (METC Brabant) determined that this study was not subject to the Medical Research Involving Human Subjects Act (WMO) and therefore informed consent was waived.
Study subjects or cohorts overlap
No study subjects or cohorts have been previously reported.
Methodology
-
Retrospective
-
Experimental
-
Multicenter study
Additional information
Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Hendrix, N., Hendrix, W., Maresch, B. et al. Artificial intelligence for automated detection and measurements of carpal instability signs on conventional radiographs. Eur Radiol (2024). https://doi.org/10.1007/s00330-024-10744-1
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00330-024-10744-1