Abstract
Purpose of Review
To highlight and review the application of artificial intelligence (AI) in kidney stone disease (KSD) for diagnostics, predicting procedural outcomes, stone passage, and recurrence rates. The systematic review was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) checklist.
Recent Findings
This review discusses the newer advancements in AI-driven management strategies, which holds great promise to provide an essential step for personalized patient care and improved decision making. AI has been used in all areas of KSD including diagnosis, for predicting treatment suitability and success, basic science, quality of life (QOL), and recurrence of stone disease. However, it is still a research-based tool and is not used universally in clinical practice. This could be due to a lack of data infrastructure needed to train the algorithms, wider applicability in all groups of patients, complexity of its use and cost involved with it.
Summary
The constantly evolving literature and future research should focus more on QOL and the cost of KSD treatment and develop evidence-based AI algorithms that can be used universally, to guide urologists in the management of stone disease.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Avoid common mistakes on your manuscript.
Introduction
Artificial intelligence (AI) refers to the computational capability of the machine to mimic and perform human cognitive tasks. Substantial amounts of data are available from the electronic medical records (EMRs) which provide important information, which aids clinicians in shared decision-making and patient counseling [1••]. Machine learning, a subfield of AI, has most readily been applied to clinical research, with techniques including deep learning (DL), artificial neural networks (ANN), natural language processing (NLP), and computer vision being applied across various subfields of urology to aid in the diagnosis as well to predict treatment outcomes [2••].
In the last two decades, there has been a rapid transition in the analysis, treatment, and monitoring of cases with kidney stone disease (KSD). The most recent example being the use of AI in radiomics to identify the stone dimensions from computed tomography (CT) and ultrasound (US) images, detecting stone composition, predicting spontaneous stone passage, and predicting outcomes of endourological procedures. The present systematic review aims to give a comprehensive summary of the contemporary applications of AI in the field of urolithiasis.
Search Strategy and Article Selection
A review of all English language literature published in the last 2 decades (2000–2020) was conducted in October 2020 using MEDLINE, Scopus, CINAHL, Clinicaltrials.gov, EMBASE, Cochrane library, Google Scholar, and Web of Science. The search strategy was conducted according to the PICO (Patient–Intervention–Comparison–Outcome) [3] criteria where patients with KSD (P) were managed with AI models (I) or traditional biostatistical models (C), and these were examined to evaluate the efficacy of AI models (O). A dedicated search string was then created based on a combination of the following keywords: “Artificial intelligence,” “AI,” “Machine learning,” “ML,” “ANN,” “convolutional networks,” “CNN,” “deep learning,” “DL,” “urolithiasis,” “kidney stone disease,” “ureteric stones,” “nephrolithiasis,” “renal calculi,” “kidney calculi,” and “bladder stones.”
The systematic review was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) checklist [4]. Only original articles in the English language were included.
Inclusion criteria:
-
1.
Articles on KSD and AI
-
2.
Full-text original articles on all aspect of diagnosis, treatment, and outcomes of stone disease
Exclusion criteria:
-
1.
Editorials, commentaries, abstracts, reviews, or book chapters
-
2.
Animal, laboratory, or cadaveric studies
The literature review was performed according to the inclusion and exclusion criteria. The titles and abstracts were evaluated and after the screening, analysis of the full article text was conducted for selected articles that met the inclusion criteria. The references list of the selected articles was individually and manually reviewed to screen for additional articles of interest. Disagreements about eligibility were resolved by discussion for a consensus decision.
Results
Evidence Synthesis
The initial search identified a total of 557 unique articles. From this list, 113 articles remained following the initial screening, with 92 remaining after a further screening of the abstracts. After additional review of the full-text articles, a total of 58 articles were identified that met our inclusion criteria and were subsequently included in the final review as per PRISMA (Fig. 1). A summary of the included studies is reported in two different tables (Tables 1 and 2) and the AI models used in each study are depicted in Fig. 2.
Applications of AI
Imaging of KSD
Ten studies evaluated the role of AI in KSD imaging for the diagnosis of stone disease. Langkvist et al. [5] used a deep learning convolutional neural network (DCNN) to distinguish ureteric stones from phleboliths based on the thin-slice CT images from the database of 465 patients. The model was tested on 88 scan images. The results showed a sensitivity of 100% with a mean false positive rate of 2.68 per patient [5]. Parakh et al. studied the diagnostic performance of the CNN on CT images for detection of urinary stones in 535 adult patients assumed to have renal calculi using two scanners. The first scanner identified the urinary tract and the second detected the stone. Using nine different variation models, it achieved an accuracy of more than 90%. The study concluded that the efficiency of CNNs can be improved by the use of transfer learning with datasets augmented with labeled images [6].
De Perrot et al. developed an ML model to distinguish kidney stones and phleboliths based on the radiomics feature extraction from low-dose CT (LDCT) images. The model reached an AUC of 0.902, an accuracy of 85.1%, and PPV and NPV of 81.5% and 90.0% respectively [7•]. Jendenber et al. (2020) trained and developed a CNN model to distinguish distal ureteric calculi and phleboliths based on the features of non-contrast CT (NCCT) images and compared these results with assessments reported by seven expert radiologists. The CNN model achieved a significantly higher accuracy of 92%, compared to 86% by the radiologists. The sensitivity, specificity, and AUC of the model to differentiate the distal ureteric calculi and phleboliths were 94%, 90%, and 0.95 respectively [8].
Racine et al. applied novel deep learning image reconstruction (DLIR) methods to check its impact on dose reduction in abdominal CT and compared the results with partial model-based iterative reconstruction (ASiR-V) and filtered back-projection (FBP). In terms of results, DLIR outperformed ASiR-V in all simulated clinical scenarios and at all dose and contrast levels [9].
Krishna et al. proposed a field programmable gate array (FPGA)-based computer-aided detection (CAD) algorithm on US images for detecting abnormality in the kidney, by extracting intensity histogram and Haralick features from the segmented region of interest and trained support vector machine (SVM) and multilayer perception (MLP) classifiers, to classify between renal stones and cyst. The proposed algorithm gave an accuracy of 98.1%, sensitivity of 100%, and specificity of 96.8% in detecting the exact abnormality present on the renal US images. The proposed algorithm and its hardware could help diagnose renal pathology in absence of radiologists and internet connectivity [10].
Li et al. [11] trained a back-propagation ANN to evaluate the best method for localizing renal stone on PCNL between B-mode US and X-ray. Data from 208 patients were used for training while data from 47 patients were used for testing. The results showed that the B-mode US with X-ray was preferred for puncture localization of complex and small renal stones while X-ray was preferred as a single modality in case of simple and larger calculi [11].
Selvarani and Rajendran [12] used the meta-heuristic support vector machine for identifying renal stones on US images. The algorithm was trained with 250 US images (150 with stones and 100 without stones) and achieved an accuracy of 98.8% [12].
Ishioka et al. (2019) used a CNN (ResNet) algorithm for CAD of urinary tract calculi using more than 1000 X-ray KUB images from 3 different hospitals. Eight hundred and twenty-seven images were used as training data and 190 images as test data. In the test dataset, the positive predictive value, sensitivity, and F-measure were 0.49, 0.72, and 0.58, respectively [13].
Nithya et al. developed an ANN model for the detection of kidney stones based on the US images using a multi-kernel k-means clustering algorithm. The algorithm mainly classified the image as abnormal or normal using the classifier and then the abnormal images were further segmented for the detection of kidney stones. The study showed that the linear and quadratic based model achieved an accuracy of 99.6% [14].
Detecting Stone Composition
Nine studies looked at the role of AI in the detection of stone composition. Kreigshauser et al. predicted the stone composition from the CT images by using ML-based algorithms. For stone sizes > 5 mm, they achieved an accuracy of 100% for distinguishing stones containing uric acid (UA) from others. Furthermore, they achieved an accuracy of 75% in distinguishing non-uric acid (non-UA) subtypes [15].
Kazemi and Mirroshandel collected information from 936 patients and derived an ensemble learning model for predicting renal stone composition based on various parameters such as uric acid levels; serum calcium levels; gender; associated symptoms like loin pain, nausea, and vomiting; urinary tract infection; and co-morbidities like hypertension and diabetes. An accuracy of 97.1% was achieved with this model and it showed that these results could be applied in future research activities for predicting stone composition and for recurrence prevention [16•].
Aldoukhi et al. and Black et al. trained a DCNN model to detect stone composition based on the images. Sixty-three stones were taken in the study and the results displayed accuracy of identifying the stone composition of nearly 94%, 90%, 75%, and 86% for uric acid, calcium oxalate, cysteine, and triple phosphate stones respectively. The overall accuracy was 85% in the detection of stone composition. These results have laid a foundation for future research on the detection of the stone composition directly from the endoscopic images and could automate the laser settings for treatment [17, 18•].
Bejan et al. developed StoneX, a natural language processing (NLP) algorithm for mining kidney stone composition in a large-scale electronic health record (EHR) of > 125 million notes. Overall, the system achieved a positive predictive value > 90% for all stone types except for uric acid (PPV = 87.5%). Survival analysis from second stone surgery showed statistically significant differences among stone types (P = 0.03). Several phenotype associations were also found such as uric acid—diabetes mellitus type 2; struvite—UTI and neurogenic bladder; hydroxyapatite-neurogenic bladder and pulmonary collapse; and brushite—hypercalcemia or calcium metabolism disorder. This showed that these tools will enable high fidelity kidney stone research from the EHR [19].
Hokamp et al. used dual-energy CT (DECT) images of 200 kidney stones with known composition to train the ML model and predict the main stone composition, in the pure (n = 116) and mixed (n = 84) kidney stones of sizes 3–18 mm. Both normal-dose and low-dose CT protocols were used for image acquisition. Accuracy was calculated based on stones and voxel both. While the model achieved an accuracy of nearly 90% in predicting the key component of the stone, the lowest accuracy was achieved while detecting the key component of struvite stones [20].
Sacli et al. applied the k-nearest neighbor ML algorithm to classify the renal calculi into cystine, calcium oxalate, and struvite stones based on the dielectric properties of the renal calculi. It achieved an accuracy of 98.1% in detecting the stone composition and classifying correctly based on the Cole–Cole parameters [21].
Cui et al. applied the radiomics algorithm to the NCCT images to distinguish between infective and non-infective stones. Twenty-seven radiomic features from CT images were finalized based on the LASSO algorithm. The model was trained with images of clinically confirmed infective (n = 98) and non-infective (n = 59) patients. The algorithm could differentiate with an accuracy of 90.7%. The sensitivity, specificity, PPV, and NPV were 85.8%, 93.9%, 91%, and 91% respectively [22].
Zhang et al. trained SVM classifiers to assess the accuracy of computed tomography texture analysis (CTTA) in differentiating non-uric acid stones from uric acid stones on NCCT in patients with urinary calculi using commercially available software, with ex vivo Fourier transform infrared spectroscopy (FTIR) as the reference standard. The average SVM accuracy ranged from 88 to 92% (after tenfold cross-validation) with an AUC of 0.965 ± 0.029 with a sensitivity of 94.4% and specificity of 93.7%, thereby concluding that CTTA can be used to accurately differentiate UA stones from non-UA stones in vivo using NCCT images [23].
Extracorporeal Shockwave Lithotripsy (ESWL)
Twelve studies looked at the role of AI in ESWL. Poulakis et al. used ANN to predict the outcomes of ESWL used for the treatment of lower calyceal stones using the retrospective dataset of 680 patients, achieving an accuracy of 92%. The predictors of stone clearance included the pattern of dynamic urinary transport, followed by infundibuloureteropelvic angle, body mass index (BMI), caliceal pelvic height, and stone size [24].
Hamid et al. took data of 60 patients in whom ESWL was successfully used to fragments stones and used it to train ANN and subsequently applied it to 22 patients for predicting the number of shockwaves for adequate fragmentation. The overall prediction accuracy was 75% and showed that ANN could identify patients who were not likely to gain any advantage from ESWL and that further studies could improve the prediction accuracy [25•].
Gomha et al. used ANN models to improve the prediction of stone-free status after ESWL for ureteral stones and compared them to a logistic regression (LR) model using a dataset of 984 patients (70% training: 30% test). The sensitivity and specificity of the LR and ANN models were 100%, 0.0%, and 77.9%, 75% respectively with an overall accuracy of 93.2% and 77.7% [26].
Goyal et al. compared the accuracy of ANN and multivariate regression analysis (MVRA) for renal stone fragmentation by ESWL. A total of 276 patients were included, 196 for training the ANN, and 80 for testing it. ANN proved to have a better coefficient of correlation (COC) (power = 0.8343, number of shocks = 0.9329) than MVRA (power = 0.0195, number of shocks = 0.5726), thereby suggesting a better tool to analyze the stone fragmentation by ESWL [27]. Moorthy and Krishnan applied first-order statistical methods and ANN to NCCT images for predicting stone fragmentation using ESWL. The model had accuracy, sensitivity, and specificity of 90%, 80.7%, and 98.4% respectively [28].
Handa et al. developed a method to quantify the hemorrhagic injury to kidneys post ESWL using a Multi-Spectral Neural Network (MSNN) classifier for segmentation and classification of MRI images. The model achieved a high accuracy (79%) and the prediction values correlated very well (R = 0.96) with the morphology [29].
Seckiner et al. and Choo et al. used ANN and machine learning methods to accurately predict the outcomes post ESWL for renal calculi and ureteral calculi respectively. Seckiner et al. achieved an accuracy of 88.2%, after ANN trained data of 139 patients and testing it on 32 patients. Choo et al. achieved an accuracy of 92% in their study of 791 patients [30, 31]. Mannil et al. used 5 different AI models and predicted the success rate of ESWL in patients with 5–20 mm kidney stones based on 224 3D-texture analysis features obtained from the CT images. The three features which were found to be significant in predicting the success of ESWL were BMI, skin stone distance, and stone size. The random forest classifier (RF) was found to be the most accurate with an overall AUC of 0.79 [32].
Singla et al. proposed a computer vision algorithm to improve stone targeting during ESWL treatment. The model was trained using a retinanet algorithm on annotated fluoroscopic images of 90 patients and then tested on 12 patients, using a total of 2413 images. The average precision (AP) was 0.7 ± 0.1 while the average detection time (± stdev) was 63 ± 1 ms [33].
Yang et al. used ML methods such as random forest (RF), extreme gradient boosting trees (XGboost), and light gradient boosting method (LightGBM) to predict the success rate of ESWL and also assess the factors affecting the outcomes using a dataset of 358 patients in the ratio of 80:20 as training and test dataset. In predictions for stone-free, LightGBM yielded the best accuracy (87.9%) with AUC 0.84–0.85 and sensitivity and specificity of 0.74–0.78 and 0.92–0.93 respectively [34].
Seltzer et al. applied DL techniques to develop a prediction algorithm to provide better care and improve shared decision making using a dataset from 75/25 randomized split of 46,891 treatments sampled from the International Stone Registry (ISR). The prediction accuracy of stone clearance was 88% with an AUC of 0.95 while predicting complications yielded an accuracy of 77% and an AUC of 0.73 on the validation set [35].
Percutaneous Nephrolithotomy (PCNL)
Four studies looked at the role of AI in PCNL. Aminsharifi et al. developed an ANN algorithm to predict outcomes of PCNL by training the machine with data of 200 patients and later applied it on 254 study subjects. The algorithm was able to achieve a sensitivity and accuracy range of 81 to 98.2%. Aminsharifi et al. studied data of 146 adult patients in whom PCNL was done to validate the efficiency of a machine-based learning algorithm for predicting the outcomes after PCNL and to compare results with CROES (Clinical Research Office of Endourological Society) nomogram and Guy’s Stone Score (GSS). This program predicted the PCNL results with an accuracy of up to 95% [36, 37••].
Shabaniyan et al. developed a decision support system (DSS) using ML techniques to predict the outcomes of surgical treatment for renal calculus. The algorithm was trained with a dataset of 254 patients and 26 parameters which comprised variables from patient’s history, stone composition, and laboratory investigations. This model achieved an accuracy of 94.8%, 85.2%, and 95% in predicting outcomes, stent requirement post-procedure, and the need for blood transfusion respectively [38].
Taguchi et al. developed a renal phantom model using automated needle targeting with an X-ray system and compared the feasibility of AI-driven robot-assisted fluoroscopy-guided (RAG) puncture using the US. Seventeen surgeons participated and parameters such as the number of needle punctures, device setup time, fluoroscopic time, and total procedural time were recorded for the analyses. The RAG group was better across all parameters with a statistically significant difference (p < 0.001) with a single puncture success rate of 100% in the RAG group [39].
Ureteroscopy (URS)
Inadomi et al. developed a Random Forest ML model to predict the requirement of stent insertion post-URS to help improve patient counseling and shared decision making using registry data of 3224 patients who underwent stent insertion. The researchers divided the dataset randomly into training and testing sets at a ratio of 2:1. The variables used were age, prior stent placement, BMI, stone location, procedure acuity, and history of stone surgery The model achieved an AUC of 0.70 on the test set [40].
Prediction of Outcomes of Endourological Procedures
Alger et al. developed a neural network using pre-and post-procedural data to predict stone-free status for patients treated with ESWL, PCNL, or URS. The model was trained on data from 821 patients and could predict the stone-free rate (SFR) with sensitivity, specificity, PPV, and NPV of 70%, 61%. 61.4, and 72.3 respectively. The model achieved a ROC-AUC of 0.73 [41].
Kadlec et al. designed a model that could predict outcomes of various endourological procedures (PCNL, URS, SWL) and studied the input and outcome variables of 382 renal units. The model predicted stone-free status (defined as stone-free on X-Ray KUB or < 4 mm on CT) with sensitivity and sensitivity of 75.3% and 60.4% respectively. It also predicted the need for a secondary procedure with 98.3% specificity but only 30% sensitivity. This study laid the foundation for the development of similar predictive nomograms in the future [42].
Zhao et al. used Bayesian network meta-analysis (NWA) to assess the efficacy and safety of various minimally invasive procedures for 10–20 mm pediatric renal stones and found that ESWL was inferior to RIRS, mPCNL (mini PCNL), and PCNL for 10–20 mm pediatric renal stones, among which SMP (supermini PCNL) was the most ideal option, associated with the least possibility of complications and highest probability of stone clearance [43].
Prediction of Spontaneous Stone Passage (SSP)
Five studies looked at the role of AI in SSP. Cummings et al. designed the ANN model to predict the passage of ureteric calculus based on patient, clinical, and laboratory variables. Out of 181 patients, data from 125 were used to train the model. Of the test dataset of 55 cases, the model correctly predicted SSP in 76% [44].
Parekattil et al. designed and validated a neural network model to predict outcomes and duration of stone passage for ureteral/renal calculi using 6 mm as a cut-off. The model was also evaluated using a 6 mm largest stone dimension cut-off and was tested on 384 patients from 6 different external institutes (other than the design institute). It provided an accuracy of 88% with ROC-AUC 0.9 and duration of passage accuracy of 80% with ROC of 0.8 [45].
Moro et al. applied support vector machines (SVM) to predict the spontaneous passage of ureteric calculi. The machine was trained with a dataset of 1163 patients and the results were compared with those obtained with LR and ANN. The SVM-based approach yielded a sensitivity and specificity of more than 84%. It also suggested the most important factors responsible for SSP in descending order as calculus size, its location, and the duration of symptoms [46].
Kim et al. used LR and MLP-ML models to predict the spontaneous ureteral stone passage using a dataset of 833 patients. AUCs for ROC curves for MLP and logistic regression were 0.859 and 0.847 for stones < 5 mm and 0.881 and 0.817 for stones between 5–10 mm, respectively [47]. Solakhan et al. used the ANN model to estimate the SSP and to determine the effectivity of predictive factors in patients with ureteral stones. A total of 192 patients included a training group (n = 132), the validation group (n = 30), and a test group (n = 30). The accuracy rate achieved was 99.1% in the training group, 89.9% in the validation group, and 87.3% in the test group. It was revealed that certain criteria (stone size, body weight, pain score, erythrocyte sedimentation rate (ESR), and C-reactive protein (CRP)) were relatively more significant for saving treatment cost and time, thereby avoiding unnecessary treatment [48•].
Various Other AI Applications in Diagnosis and Prediction in Urolithiasis
Chiang et al. predicted the association of stone diseases with genetic polymorphisms as well as dietary, drinking, and exercise habits of the patients using tools like discriminant analysis (DA) and ANN. Four different genes vascular endothelial growth factor, urokinase, cyt-p450c17, and E-cadherin were compared between 151 and 105 patients with and without KSD respectively. Beverages and water consumption and outdoor exercise activities were also considered. The results showed that DA classified 74% and ANN classified 89% correctly. ANN was also proven to be better than DA when all the factors were pooled together [49].
Tanthanuch and Tanthanuch developed an ANN model to identify upper urinary tract calculi prediction using data of 168 patients, divided into 6 categories and 20 variables. The results of testing data showed 100% accuracy with output data between 0–0.38, 0.38–0.65, and 0.65–1 suggestive of being calculi free, probable calculi, and prone to having calculi respectively [50].
Dussol et al. used ANN models to compare 11 clinical and biochemical parameters in 119 males who were idiopathic calcium stone formers and 96 males in the control group. With ANN, supersaturation (ROC = 0.73) and urea (ROC 0.72) were the most discriminants while the other variables such as family history and urinary calcium, citrate, oxalate, urate, sodium, and calcemia, age, and BMI were not statistically different between the two groups. In addition to high supersaturation, the negative impact of protein intake was confirmed [51].
Dussol et al. [52] used ANN models to compare the risk factors (age, BMI, calcemia, calcium oxalate supersaturation, and 24h calciuria, oxaluria, uricosuria, citraturia, urea, and sodium) for idiopathic calcium nephrolithiasis in 119 males and 59 females with and without a family history of renal stones. For men without and with a positive family history, the most discriminant variable was 24h urea (ROC = 0.76) and supersaturation (ROC = 0.67) respectively. For women without and with positive family history, the most significant discriminant was calcemia (ROC = 0.67) and supersaturation (ROC = 0.70) respectively [51].
Eken et al. [53] applied ANN, logistic regression analysis (LR), and genetic algorithm (GA) on data of 227 patients for the diagnosis of renal colic. ANN demonstrated 94.9% and 78.4% sensitivity and specificity respectively. The likelihood ratios were 4.4 (positive) and less than 0.1 (negative). These results can be extrapolated in emergency settings for diagnosis and prediction of colicky pain due to renal calculi and can also help in making clinical decisions [52].
Cauderella et al. applied the ANN model as well as applied conventional statistics (one-way ANOVA and three discriminant analyses: standard, backward stepwise, and forward stepwise) to predict recurrence episodes within 5 years after first clinical diagnosis and metabolic evaluation of real stone based on dataset available from 80 patients with idiopathic calcium stone disease. The model correctly predicted 90% of all cases [54].
Jahantigh et al. developed a fuzzy expert system, as a computer-aided system for the diagnosis of KSD. Results indicated that by examining 21 indicators in the diagnosis of seven cases of kidney disease, KSD was ascertained in 63% and this was compatible with kidney physicians [55]. Chen et al. tested a big data approach to infer and validate a “multi-domain” personalized diagnostic acute care algorithm for KSD combining demographic, clinical, and laboratory variables using statistical and ML models with feature selectors. Data of 38,579 adult patients of which 217 were diagnosed with renal calculi, and 7446 with acute pain (but no renal calculi) were studied. The multi-domain approach using logistic regression yielded an AUROC of 0.86 and a sensitivity/specificity of 0.81/0.82 in cross-validation [56].
Sreelatha and Ezhilarasi also proposed a computer-aided diagnostic tool useful in the automatic classification of kidney images. They divided it into normal, simple cysts, kidney stones, and the less investigated complex cystic renal cell carcinoma (RCC) using SVM classifier and reduced feature set of 18 from the original size of 163 using principal component analysis, achieving an overall accuracy of 96.7% [57].
Li and Elliot assessed the accuracy of NLP in identifying a group of patients positive for ureteric stones on CT KUB reports (n = 1874). The accuracy of NLP was 85% with a sensitivity and specificity of 66% and 95% respectively. The low sensitivity and high specificity were due to the lack of feature extraction tools tailored for analyzing radiology text, the incompleteness of the medical lexicon database, and the heterogeneity of unstructured reports [58]. Chen et al. used ML methods to study the risk factors (hypertension, increased protein content in stones, decreased calcium oxalate supersaturation, and old age) causing renal stones > 20 mm using demographic variables, 24-h urine profile, and stone profile data of 277 patients. This model yields sensitivity and specificity of 83% and 56% respectively [59].
Jungmann et al. developed an NLP algorithm that was trained on manual feedback and used to analyze 1714 narrative LDCT reports to automatically capture clinical information and positive hit rates. Urolithiasis was affirmed in 72% of the reports. In 38%, at least one stone was described in the kidney and in 45% at least one stone was described in the ureter. Previous stone history and the combination of obstructive uropathy and loin pain had the highest association with positive urolithiasis (p < 0.001) [60]. Luo et al. developed the Wisconsin stone quality of life (WISQOL) machine learning algorithm (WISQOL-MLA) to predict patients QOL based on demographic, symptomatic, and clinical data collected for the validation of WISQOL. The dataset of 3206 patients was split into 70/10/20% training/validation/testing ratio. Gradient boosting obtained a test correlation of 0.622 while DL and multivariate regression obtained a correlation of 0.592 and 0.437 respectively. Quintile stratification on all WISQOL patients obtained an average test AUC of 0.70 for the 5 classes. The model performed best in distinguishing between the lowest (0.79) and highest quintile (0.83) [61]. Kletzmayr et al. used an image-based machine learning approach to screen chemically modified myo-inositol hexakisphosphate (IP6) analogues, which enables the identification of a highly active divalent inositol phosphate molecule, which can completely inhibit the crystallization process thereby representing a new treatment option for CaOx nephropathies [62].
Strengths, Limitations, and Areas of Future Research
The use of a wide variety of AI models and algorithms did not allow us to pool the data together. However, we have included all AI-related endourology articles and summarized its current clinical use and role within endourology.
AI has been used in all areas of KSD including diagnosis, for predicting treatment suitability and success, basic science, QOL, and recurrence of stone disease. However, it is still a research-based tool and is not used universally in clinical practice. This could be due to a lack of data infrastructure needed to train the algorithms, wider applicability in all groups of patients, complexity of its use, and cost involved with it. Future AI studies should also focus more on QOL and the cost of KSD treatment and come up with common algorithms that can be used universally [63••,64••].
Conclusion
The application of AI in KSD and its various subfields appears promising. It is being used for diagnostics, predicting procedural outcomes, stone passage, and recurrence rates. AI-driven management strategies hold great promise for the future and provide an essential step forward in providing more personalized patient care and improving shared decision making. Although not in routine clinical practice currently, we will see a shift in the clinical paradigm as AI applications will find their place in the guidelines and all aspects of KSD management.
References
Papers of particular interest, published recently, have been highlighted as: • Of importance •• Of major importance
••Beam AL, Kohane IS. Big Data and Machine Learning in Health Care. JAMA. 2018;319(13):1317-1318. This opinion on JAMA gives a better understanding of machine learning and big data with simple examples and their integration into healthcare.
••Shah M, Naik N, Somani BK, Hameed BMZ. Artificial intelligence (AI) in urology-Current use and future directions: An iTRUE study. Turk J Urol. 2020 Nov;46(Supp. 1):S27-S39. A narrative review about various subsets of artificial intelligence and their application in urology.
Moher D, Altman DG, Liberati A, Tetzlaff J. PRISMA statement. Epidemiology. 2011;22(1):128.
Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann Intern Med. 2009;151:W65–94.
Langkvist M, Jendeberg J, Thunberg P, Loutfi A, Liden M. Computer-aided detection of ureteral stones in thin-slice computed tomography volumes using Convolutional Neural Networks. Comput Biol Med. 2018;97:153–60.
Parakh A, Lee H, Lee JH, Eisner BH, Sahani DV, Do S. Urinary Stone Detection on CT Images Using Deep Convolutional Neural Networks: Evaluation of Model Performance and Generalization. Radiol Artif Intell. 2019 Jul 24;1(4):e180066.
•De Perrot T, Hofmeister J, Burgermeister S, et al. Differentiating kidney stones from phleboliths in unenhanced low-dose computed tomography using radiomics and machine learning. Eur Radiol. 2019;29(9):4776–82. A study using machine learning algorithm on radiomics to differentiate urolithiasis and phleboliths.
Jendeberg J, Thunberg P, Lidén M. Differentiation of distal ureteral stones and pelvic phleboliths using a convolutional neural network. Urolithiasis. 2020;27:1–9.
Racine D, Becce F, Viry A, Monnin P, Thomsen B, Verdun FR, Rotzinger DC. Task-based characterization of a deep learning image reconstruction and comparison with filtered back-projection and a partial model-based iterative reconstruction in abdominal CT: A phantom study. Physica Med. 2020;1(76):28–37.
Krishna KD, Akkala V, Bharath R, Rajalakshmi P, Mohammed AM, Merchant SN, Desai UB. Computer aided abnormality detection for kidney on FPGA based IoT enabled portable ultrasound imaging system. Irbm. 2016;37(4):189–97.
Li G, Liu Z, Zhang Y, et al. Discrimination analysis of B-mode ultrasonography and X-ray on the percutaneous nephrolithotomy localization of urinary stones: a prospective, controlled study. Int J Clin Exp Med. 2016;9(2):2261–8.
Selvarani S, Rajendran P. Detection of renal calculi in ultrasound image using meta-heuristic support vector machine. J Med Syst. 2019;43(9):300.
Ishioka J, Kobayashi M, Okuno T, et al. Computer-aided diagnosis with a convolutional neural network algorithm for automated detection of urinary tract stones using kub. J Urol. 2019;201(4):e845.
Nithya A, Appathurai A, Venkatadri N, Ramji DR, Anna Palagan C. Kidney disease detection and segmentation using artificial neural network and multi-kernel k-means clustering for ultrasound images. Meas J Int Meas Confed. 2020;149.
Kriegshauser JS, Silva AC, Paden RG, et al. Ex vivo renal stone characterization with single-source dual-energy computed tomography: a multiparametric approach. Acad Radiol. 2016;23(8):969–76.
•Kazemi Y, Mirroshandel SA. A novel method for predicting kidney stone type using ensemble learning. Artif Intell Med. 2018;84:117–26. The pilot study on various data mining algorithms to predict the chances of nephrolithiasis.
Aldoukhi AH, Law H, Black KM, Roberts WW, Deng J, Ghani KR. Deep learning computer vision algorithm for detecting kidney stone composition: towards an automated future. J Urol. 2019;201(4):e75–6.
• Black KM, Law H, Aldoukhi A, Deng J, Ghani KR. Deep learning computer vision algorithm for detecting kidney stone composition. BJU Int. 2020;125(6):920–924. The study using Resnet -101 to automatically detect kidney stones composition using digital photographs of kidney stones.
Bejan CA, Lee DJ, Xu Y, Hsi RS. Performance of a natural language processing method to extract stone composition from the electronic health record. Urology. 2019;132:56–62.
Hokamp NG, Lennartz S, Salem J, dos Santos DP, Heidenreich A, Maintz D, Haneder S. Dose independent characterization of renal stones by means of dual energy computed tomography and machine learning: an ex-vivo study. Eur Radiol. 2020;30(3):1397–404.
Saçlı B, Aydınalp C, Cansız G, Joof S, Yilmaz T, Çayören M, Önal B, Akduman I. Microwave dielectric property based classification of renal calculi: Application of a kNN algorithm. Comput Biol Med. 2019;112:103366.
Cui X, Zhao Z, Zhang G, Chen S, Zhao Y, Lu J. Analysis and classification of kidney stones based on Raman spectroscopy. Biomed Opt Express. 2018;9(9):4175–83.
Zhang GMY, Sun H, Shi B, Xu M, Xue HD, Jin ZY. Uric acid versus non-uric acid urinary stones: differentiation with single energy CT texture analysis. Clin Radiol. 2018;73(9):792–9.
Poulakis V, Dahm P, Witzsch U, De Vries R, Remplik J, Becht E. Prediction of lower pole stone clearance after shock wave lithotripsy using an artificial neural network. J Urol. 2003;169(4):1250–6.
•Hamid A, Dwivedi US, Singh TN, et al. Artificial neural networks in predicting optimum renal stone fragmentation by extracorporeal shock wave lithotripsy: a preliminary study. BJU Int. 2003;91(9):821–4. A pilot study using ANN to predict optimum renal stone fragmentation in patients treated with ESWL.
Gomha MA, Sheir KZ, Showky S, Abdel-Khalek M, Mokhtar AA, Madbouly K. Can we improve the prediction of stone-free status after extracorporeal shock wave lithotripsy for ureteral stones? A neural network or a statistical model? J Urol. 2004;172(1):175–9.
Goyal NK, Kumar A, Trivedi S, Dwivedi US, Singh TN, Singh PB. A comparative study of artificial neural network and multivariate regression analysis to analyze optimum renal stone fragmentation by extracorporeal shock wave lithotripsy. Saudi J Kidney Dis Transpl. 2010;21(6):1073–80.
Moorthy K, Krishnan M. Prediction of fragmentation of kidney stones: a statistical approach from NCCT images. Can Urol Assoc J. 2016;10(7):E237–40.
Handa RK, Territo PR, Blomgren PM, Persohn SA, Lin C, Johnson CD, Jiang L, Connors BA, Hutchins GD. Development of a novel magnetic resonance imaging acquisition and analysis workflow for the quantification of shock wave lithotripsy-induced renal hemorrhagic injury. Urolithiasis. 2017;45(5):507–13.
Seckiner I, Seckiner S, Sen H, Bayrak O, Dogan K, Erturhan S. A neural network - based algorithm for predicting stone - free status after ESWL therapy. Int Braz J Urol. 2017;43(6):1110–4.
Choo MS, Uhmn S, Kim JK, et al. A Prediction Model using machine learning algorithm for assessing stone-free status after single session shock wave lithotripsy to treat ureteral stones. J Urol. 2018;200(6):1371–7.
Mannil M, von Spiczak J, Hermanns T, Poyet C, Alkadhi H, Fankhauser CD. Three-dimensional texture analysis with machine learning provides incremental predictive information for successful shock wave lithotripsy in patients with kidney stones. J Urol. 2018;200(4):829–36.
Singla R, Lundeen C, Forbes C, Hogarth D, Nguan C. Fluoroscopic targeting of renal calculi during extracorporeal shockwave lithotripsy using a machine learning algorithm. J Urol. 2019;201(4):e474.
Yang SW, Hyon YK, Na HS, Jin L, Lee JG, Park JM, Lee JY, Shin JH, Lim JS, Na YG, Jeon K. Machine learning prediction of stone-free success in patients with urinary stone after treatment of shock wave lithotripsy. BMC Urol. 2020;20(1):1–8.
Seltzer R, Hamilton BD, Klett D, Chen Z, Nakada SY, Gerber G. The prediction of treatment success and complications of shockwave lithotripsy using artificial intelligence. J Endourol. 2019;33:A291.
Aminsharifi A, Irani D, Tayebi S, Jafari Kafash T, Shabanian T, Parsaei H. Predicting the Postoperative Outcome of Percutaneous Nephrolithotomy with Machine Learning System: Software Validation and Comparative Analysis with Guy's Stone Score and the CROES Nomogram. J Endourol. 2020;34(6):692-699.
••Aminsharifi A, Irani D, Pooyesh S, et al. Artificial Neural Network System to Predict the Postoperative Outcome of Percutaneous Nephrolithotomy. J Endourol. 2017;31(5):461-467. A pilot study to construct and apply an artificial neural network (ANN) system for prediction of different outcome variables of percutaneous nephrolithotomy (PCNL).
Shabaniyan T, Parsaei H, Aminsharifi A, et al. An artificial intelligence-based clinical decision support system for large kidney stone treatment. Australas Phys Eng Sci Med. 2019;42(3):771–9.
Taguchi K, Hamamoto S, Okada A, et al. Robot-assisted fluoroscopy versus ultrasound-guided renal access for nephrolithotomy: a phantom model benchtop study. J Endourol. 2019;33(12):987–94.
Inadomi M, Ghani K, Kim T, et al. Using a clinical registry and machine learning to predict ureteral stent placement following ureteroscopy. J Urol. 2019;201(4):e460.
Alger PW, Niederberger CS, Turk TMT. Neural network to predict stone free status after SWL, PCNL or ureteroscopy. J Urol. 2009;181(4):492.
Kadlec A, Ohlander S, Hotaling J, Hannick J, Niederberger C, Turk TM. Nonlinear logistic regression model for outcomes after endourologic procedures: a novel predictor. Urolithiasis. 2014;42:323–7.
Zhao FZ, Li J, Tang L, Li CM, Zhang Y, Wang WY, Chen N, Tian Y. Comparison of efficacy and safety of minimally invasive procedures for 10-20 mm pediatric renal Stones-A bayesian network meta-analysis. J Pediatr Urol. 2020;16(6):771–781.
Cummings JM, Boullier JA, Izenberg SD, Kitchens DM, Kothandapani RV. Prediction of spontaneous ureteral calculous passage by an artificial neural network. J Urol. 2000;164(2):326–8.
Parekattil SJ, White MD, Moran ME, Kogan BA. A computer model to predict the outcome and duration of ureteral or renal calculous passage. J Urol. 2004;171(4):1436–9.
Dal Moro F, Abate A, Lanckriet GRG, et al. A novel approach for accurate prediction of spontaneous passage of ureteral stones: support vector machines. Kidney Int. 2006;69(1):157–60.
Kim J, Ahn HK, Koo KC, Chung BH, Lee KS. Development of prediction models of spontaneous ureteral stone passage through machine learning: comparison with conventional statistical analysis. J Urol. 2020 Apr;203(Supplement 4):e273.
•Solakhan M, Seckiner SU, Seckiner I. A neural network-based algorithm for predicting the spontaneous passage of ureteral stones. Urolithiasis. 2020;48:527–32. A pilot study using an artificial neural network model (ANN) to estimate the stone passage rate and to determine the effectivity of predictive factors on this rate in patients with ureteral stones.
Chiang D, Chiang HC, Chen WC, Tsai FJ. Prediction of stone disease by discriminant analysis and artificial neural networks in genetic polymorphisms: a new method. BJU Int. 2003;91(7):661–6.
Tanthanuch M, Tanthanuch S. Prediction of upper urinary tract calculi using an artificial neural network. J Med Assoc Thail. 2004;87(5):515–8.
Dussol B, Verdier JM, Le Goff JM, Berthezene P, Berland Y. Artificial neural networks for assessing the risk of urinary calcium stone among men. Urol Res. 2006;34(1):17–25.
Dussol B, Verdier JM, Goff JML, Berthezene P, Berland Y. Artificial neural networks for assessing the risk factors for urinary calcium stones according to gender and family history of stone. Scand J Urol Nephrol. 2007;41(5):414–8.
Eken C, Bilge U, Kartal M, Eray O. Artificial neural network, genetic algorithm, and logistic regression applications for predicting renal colic in emergency settings. Int J Emerg Med. 2009;2(2):99–105.
Caudarella R, Tonello L, Rizzoli E, Vescini F. Predicting five-year recurrence rates of kidney stones: an artificial neural network model. Arch Ital di Urol e Androl. 2011;83(1):14–9.
Jahantigh FF, Malmir B, Avilaq BA. A computer-aided diagnostic system for kidney disease. Kidney Res Clin Pract. 2017;36(1):29–38.
Chen Z, Bird VY, Ruchi R, Segal MS, Bian J, Khan SR, Elie MC, Prosperi M. Development of a personalized diagnostic model for kidney stone disease tailored to acute care by integrating large clinical, demographics and laboratory data: the diagnostic acute care algorithm - kidney stones (DACA-KS). BMC Med Inform Decis Mak. 2018;18(1):72.
Sreelatha P, Ezhilarasi M. Image texture based hybrid diagnostic tool for kidney disease classification. J Med Imaging Heal Informatics. 2018;8(9):1899–908.
Li AY, Elliot N. Natural language processing to identify ureteric stones in radiology reports. J Med Imaging Radiat Oncol. 2019;63(3):307–10.
Chen Z, Prosperi M, Bird VG, Bird VY. Analysis of factors associated with large kidney stones: stone composition, comorbid conditions, and 24-h urine parameters-a machine learning-aided approach. SN Compr Clin Med. 2019;1(8):597–602.
Jungmann F, Kämpgen B, Mildenberger P, et al. Towards data-driven medical imaging using natural language processing in patients with suspected urolithiasis. Int J Med Inform. 2020;137:104106.
Luo JW, Nguyen DD, Lim JR, Scotland KB, Bechis SK, Sur RL, Nakada SY, Antonelli JA, Streeper NM, Sivalingam S, Viprakasit DP. Wisconsin quality of life machine learning algorithm for predicting quality of life in kidney stone patients. J Urol 2020;203(Supplement 4):e652
Kletzmayr A, Mulay SR, Motrapu M, Luo Z, Anders HJ, Ivarsson ME, Leroux JC. Inhibitors of Calcium Oxalate Crystallization for the Treatment of Oxalate Nephropathies. Adv Sci (Weinh). 2020;7(8):1903337.
••New F, Somani BK. A complete world literature review of quality of life in patients with kidney stone disease. Curr Urol Rep. 2016;17(12):88. A systematic review to evaluate the current evidence for the quality of life (QOL) in patients with kidney stone disease (KSD).
••Geraghty R, Jones P, Herrmann T, Aboumarzouk O, Somani BK. Ureteroscopy seems to be clinically and financially more cost effective than shock wave lithotripsy for stone treatment: systematic review and Meta-analysis. WJU. 2018;36(11):1783–93. A systematic review and meta-analysis comparing the cost of ureteroscopy vs shockwave lithotripsy for renal stones.
Funding
Open access funding provided by Manipal Academy of Higher Education, Manipal. This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest
Human and Animal Rights Informed Consent
This article does not contain any studies with human or animal subjects performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the Topical Collection on Endourology
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Hameed, B.M.Z., Shah, M., Naik, N. et al. The Ascent of Artificial Intelligence in Endourology: a Systematic Review Over the Last 2 Decades. Curr Urol Rep 22, 53 (2021). https://doi.org/10.1007/s11934-021-01069-3
Accepted:
Published:
DOI: https://doi.org/10.1007/s11934-021-01069-3