Abstract
Introduction
Artificial intelligence (AI) integration in nephropathology has been growing rapidly in recent years, facing several challenges including the wide range of histological techniques used, the low occurrence of certain diseases, and the need for data sharing. This narrative review retraces the history of AI in nephropathology and provides insights into potential future developments.
Methods
Electronic searches in PubMed-MEDLINE and Embase were made to extract pertinent articles from the literature. Works about automated image analysis or the application of an AI algorithm on non-neoplastic kidney histological samples were included and analyzed to extract information such as publication year, AI task, and learning type. Prepublication servers and reviews were not included.
Results
Seventy-six (76) original research articles were selected. Most of the studies were conducted in the United States in the last 7 years. To date, research has been mainly conducted on relatively easy tasks, like single-stain glomerular segmentation. However, there is a trend towards developing more complex tasks such as glomerular multi-stain classification.
Conclusion
Deep learning has been used to identify patterns in complex histopathology data and looks promising for the comprehensive assessment of renal biopsy, through the use of multiple stains and virtual staining techniques. Hybrid and collaborative learning approaches have also been explored to utilize large amounts of unlabeled data. A diverse team of experts, including nephropathologists, computer scientists, and clinicians, is crucial for the development of AI systems for nephropathology. Collaborative efforts among multidisciplinary experts result in clinically relevant and effective AI tools.
Graphical abstract
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
In recent years, the growing digitalization of pathology departments has led to an exponential diffusion of scanners and increased use of whole slide images (WSIs) instead of or complementing traditional glass slides, with a broad improvement of teleconsultation, education, and image archiving [1]. Simultaneous progress in Machine Learning (ML) and hardware allowed the integration of artificial intelligence (AI) in pathology, leading to the development of computer-aided tools for tasks previously performed manually, and assisting pathologists in the time-consuming work of image analysis [2, 3]. One of the most intriguing digital areas is nephropathology [4], a sub-specialty dealing with low-incidence disease. Nephropathology has a long history of integrative approaches which goes back to 1979, when grayscale tissue thresholding was performed to capture a histological section of the kidney [5]. Since then, image analysis in nephropathology has been driven by multidisciplinary teams including nephrologists, biologists, pathologists, and computer scientists, leading to ongoing cross-disciplinary exchange and enrichment of the knowledge and skills of each professional involved [6, 7]. Renal pathology is a peculiar niche where a variety of histological techniques are performed routinely to reach the final diagnosis. In light microscopy, a variety of stainings traditionally including hematoxylin and eosin (H-E), periodic acid-Schiff (PAS), trichrome (TRIC) and silver staining are used to yield a range of recently clarified descriptors [8] in the respective tissue compartments, a task that can be handed to ML systems [9]. However, the need for different tools for the digitization of congo-red or crystal birefringence, immunofluorescence and electron microscopy, makes full computational integration very challenging [10, 11]. Furthermore, in the field of transplantation, histological evaluation of the donor kidney frequently includes the use of immunohistochemistry (IHC), which is integrated into the scoring system to assess features of rejection, adding an additional layer of complexity to the process [12]. So, several different tasks can be asked of a ML algorithm on kidney biopsy slides, ranging from simple tasks like counting glomeruli, quantifying IHC or segmenting areas of interstitial fibrosis to complex ones like classification of glomerular lesions, where the overlap of clinical and histological patterns requires higher computational power, greater amount of data and an efficient and smarter workflow. In this review, a comprehensive outline is provided on the historical development of image analysis and the utilization of artificial intelligence in nephropathology. Emphasis is placed on the current state of the art, and how it is addressing the challenges posed by increasing task complexity and the demand for handling large amounts of data.
Materials and methods
Our study followed the Meta-analysis of Observational Studies in Epidemiology (MOOSE) guidelines for conducting a systematic retrieval of literature [13]. The study was registered on the Open Science Framework (OSF) database with the following https://doi.org/10.17605/OSF.IO/YXUW4.
Search strategy and inclusion/exclusion criteria
We systematically searched for relevant studies in the PubMed-MEDLINE and Embase databases using a comprehensive search strategy and applying specific inclusion and exclusion criteria (Table 1). Briefly, inclusion criteria were availability of the details of an automated image analysis or the application of an AI algorithm on non-neoplastic kidney histological samples. Publications with abstracts alone were excluded, as were reviews and published letters to the editor with no original data and image analysis methods. The search was conducted up to August 15th, 2022.
No study type filters nor language restrictions were applied. References listed in all identified studies were also hand-searched to retrieve potential additional studies. Initial screening of articles by title/abstract was performed with the aid of the online systematic review web-app QRCI [14]. Two independent reviewers (GC and MR) determined the eligibility of published studies, with any disagreements resolved through consensus. The two authors independently extracted data from the included studies using a standardized form.
Data extraction
Extracted data included: authors’ names, publication year, country of study, area of specialization of the first author (pathologist, nephrologist, computer scientist or other), if the study was conducted on native or transplanted kidneys, technique used in the study (light microscopy, immunofluorescence, electron microscopy or other), staining of the slides (H-E, PAS, TRIC or multi-stain), histological region of interest (glomerulus, tubulo-interstitium, vascular compartment or whole slide), image analysis tasks or AI algorithms (quantification, detection, segmentation or classification), type of learning (supervised, unsupervised or other), if a paper-related free-to-use tool was released after publication. The term “quantification” was reserved for those cases in which an automated image analysis was performed without integration of AI (i.e. pixel-counting or rules-based approach). Statistics were extracted with Excel 2016 (Microsoft, Redmond, WA, USA) in order to analyze the trend of the various parameters and create plots and charts. Column charts were created listing publications after 2015 for easier and more informative visualization given the low number of studies done in previous years.
Results
Of the 3151 abstracts screened, 26 duplicates and 3034 articles lacking relevance to the topic were excluded; the full text was available for each remaining article. Based on the full-text screening, additional restrictions were applied (Fig. 1) until obtaining a final set of 76 original research articles. The majority were produced in the previous 7 years, and nearly half of them in the last 2 years Fig. 2a. Thirty-two articles were produced in the United States, 6 in Germany, 5 in France and China, 4 in Italy, 3 each in Brazil, Netherlands and Spain, 2 each in Switzerland, Japan and South Korea and 1 each in the UK, Taiwan, Australia, India, Finland, Romania, Iran, South Africa and Austria. The geographic distribution of the literary production is shown in Fig. 2b.
Professional profiles and integration of tools
Computer scientists were the main contributors to the output in this area (31 papers, 40.8%), followed by pathologists (26 papers, 34.2%) and nephrologists (13 papers, 17.1%), while other professionals carried out the research only occasionally (6 papers, 7.9%). Figure 2c shows the chronological trend of the professional figures most involved in scientific production in the field of digital nephropathology. Some of the works (27 papers, 36%) were followed by the release of free-to-use tools, available either in the form of downloadable software, codes or pre-trained models. This practice is spreading more and more; over the last few years more than half of the works published led to the release of a tool (Fig. 2d).
Technical setting
Only 7 works (9%) used techniques other than light microscopy (69, 91%). In particular, four works are on immunofluorescence, one on electron microscopy, one on lightsheet microscopy and one on the 3D reconstruction of glomerulus. The stains used in light microscopy were subdivided fairly evenly, with many experiments being performed on H-E (9 papers, 13%), PAS (23 papers, 33%), trichrome (7 papers, 10%), IHC (18 papers, 26%), combined approaches (10 papers, 15%) and 1 (1.5%) experiment each for Congo-Red and Toluidine Blue. There has been increased interest for PAS in recent years, as shown in (Fig. 3a).
Field of application: native vs transplant
Research has mostly focused on native kidneys (62 papers, 82%), with considerable analyses being performed on transplanted kidneys (14 papers, 18%); some works focused on a single pathology (8, 6%). More precisely, four works are on IgA nephropathy, two on lupus nephritis and two on diabetic nephropathy, while the majority cross-sectionally explored renal pathology and glomerular diseases.
Structures of the kidney and AI tasks
Most of the studies focused on the glomerulus (41 papers, 54%), fewer on tubulointerstitium (9 papers, 12%), vascular compartment (1 paper, 1%) and immune cells (1 paper, 1%), while 20 works (26%) focused on more than 1 structure (glomerulus and tubulointerstitium) or on the entire WSI. The latter recorded a notable increase in interest at the expense of the tubulointerstitial compartment, while interest in the glomerulus remained stable (Fig. 3b).
Of the 76 manuscripts analyzed, one focused on stain transformation in nephropathology, one on 3D reconstruction of the glomerulus and one on quality control of kidney sample slides. Some of the typical experiments carried out in nephropathology included quantification without the use of AI (14 papers, 18%), mainly in the early years of image analysis, and others with the use of AI, such as detection (8 papers, 11%), segmentation (31 papers, 41%), and classification (20 papers, 26%). The trend recorded in recent years is shown in (Fig. 3c).
Learning approaches
With regard to image analysis in the nephropathological community, three approaches have been tested: an automated approach without the use of AI, a supervised ML approach, and a “hybrid” supervised/unsupervised or fully unsupervised ML approach. The automated approach, which involves manually adjusting settings to carry out an automated process, was tested in only 18% of papers (14 out of 52); the supervised ML approach was the most popular, involving 68% of papers (52 out of 76) focusing on this; the hybrid or unsupervised ML approach also gained some attention, with 9% of papers (7 out of 76 total) (Table 2), with a slight but significant increase in interest in recent years (Fig. 3d).
Discussion
Digital pathology solutions may be of particular interest in the field of renal disease diagnosis for routine purposes such as the creation of expert networks and for the research field with the application of AI. Its unique multidimensional nature makes it an ideal area for integration with image analysis from multiple perspectives. However, this variability, along with a significant increase in research publications over the past 2 years, makes it challenging to monitor trends accurately. Therefore, it is crucial to trace a timeline of research development to better comprehend the current state of the art and identify future directions [22].
Informatics tools in pathology have evolved to varying degrees around the world since the infancy of informatics in pathology in the 1950s [23]. The exponential growth of this field driven by AI in the last 5 years has, however, highlighted the need for a “new” type of pathologist with adequate training in computer science, as well as the support of pathology computer scientists who can translate new ideas into clinical practice [24]. Successfully implemented training programs in pathology residency already exist, but they are a prerogative of very few universities mostly located in the USA [7]. To fully leverage the capabilities of AI, nephropathologists need access to various AI tools for different diagnostic tasks. Both commercial and open-source next-generation AI tools have become available in recent years. It is essential to acknowledge that, until now, no AI tools have obtained official approval from healthcare regulatory agencies for diagnostic purposes in nephropathology. Consequently, the utilization of AI tools in this field is predominantly experimental and research-driven. Despite this, some applications could soon successfully be used in routine practice, such as the use of a deep learning-based transformation of H&E stained tissues into other special stains, with important effects on laboratory standardization and turnaround time (TAT). Moreover, the development of software solutions that can integrate multiple AI tools into a single platform or interface is a promising step towards making these tools more widely available and accessible to healthcare professionals in the future. Proposed solutions include creating software that integrates several functions into one kit (for instance, with the creation of a kit that integrates the ability to detect, segment, and classify glomeruli) [15] and developing apps like "EMPAIA App Interface'' that can integrate AI tools into pathology workstations through widely-used web communication protocols and containerization [25].
Renal biopsies require special stains beyond H-E, leading to heterogeneity in datasets [26]. Deep learning, using deep convolutional neural networks is capable of identifying patterns in complex and heterogeneous histopathology data [27]. Image analysis quantification was initially performed on images with higher color contrast such as hematoxylin-DAB, for the detection of cells, or trichrome stain, for the detection of interstitial fibrosis. Most studies obtained good results on homogeneous datasets with a single staining, particularly in image segmentation [28,29,30]. The increase in computational capabilities and the interest in a comprehensive assessment of renal biopsy have led to an explosion of research on approaches that rely on two or more stains. Four-stain analysis showed that PAS stain achieved the best results, mainly due to less inter-laboratory variability and superior definition of boundary by highlighting basement membranes, which in turn provides superior definition of the boundary and easier segmentation tasks [31]. However, some convolutional neural networks performed better when different stains were used simultaneously for training instead of using a single stain: the authors attributed these results to the fact that many kidney pathologies are focal, and only observed in a specific section [32]. Innovative approaches to slide staining in nephropathology include virtual staining using hyperspectral imaging [33], quantitative phase imaging [34], and autofluorescence [35, 36], enabling the possibility of multiple stains upon a single slide and the computational transformation of an already stained WSI into another stain [37].
Since the Banff conference in Pittsburgh in 2019, where the potential use of AI and ML algorithms in solid organ transplantation was discussed, digitization and standardization have become increasingly pressing concerns in this field [38, 39]. To address this, a working group called the Digital Pathology Banff was formed to define standards to ensure a smooth and effective transition [32, 40, 41], while some tools providing reproducible, quantitative specific parameters, like tubulo-interstitial injury (ci, ct, ti, i,t, i-IFTA and t-IFTA parameters) [42, 43] or automatic detection for C4d (C4d parameter) [44] were developed. Other research has focused on using classification algorithms to categorize transplant biopsies into one of three categories: normal, rejection, or other diseases [32], while a smaller number of studies aimed at evaluating the pre-transplant kidney rather than evaluating rejection [12]. In this context, converting frozen tissue sections to be similar to formalin-fixed and paraffin-embedded ones can rectify cryosection artifacts while preserving clinically relevant features, resulting in significant improvements, as is done in other settings [45].
In most of the publications before 2017, the year when ML made its way into nephropathology, automated image analysis consisted mainly in thresholding and color image segmentation algorithms, aimed at detecting and quantifying pixels and areas with specific staining features [46]. Indeed, these experiments focused on slides in which the stains proposed a large image contrast such as trichrome (mostly for assessment of tubulo-interstitial fibrosis) and IHC [47,48,49]. No article reported the use of ML on kidney histological samples before that year, but it must be emphasized that in 1999 a simple single-layer perceptron network was designed and trained with features extracted from about 100 kidney transplant biopsies to predict the final diagnosis [50]. Initially, the main efforts were made to perform structure recognition through semantic segmentation, that is labeling each pixel in an image to outline object boundaries [51]. Although segmentation alone may be of limited use in routine practice, it lays the groundwork for performing more sophisticated tasks [46]. Finally, a multiclass segmentation model made its first appearance in 2019 as a single-stain model and was later followed by a multi-stain one [31, 52]. The glomerulus has been the primary target also for classification, which refers to a predictive modeling problem where a class label is assigned to an object: classifying glomerular lesions is a fundamental step toward the diagnosis of many kidney diseases, and AI has the potential to be a support tool for pathologists, thereby decreasing interobserver variability [53]. The first efforts focused on the application of well-known approaches such as k-nearest-neighborhood or convolutional neural networks, but since 2020 most works have integrated an automated computational pipeline by WSI. Gradually, improvements in detection, segmentation and feature extraction better prepared the field for the final classification task, which involves integrating two or more ML models into a fully-automated workflow (i.e., one for features extraction and one for classification) [30, 32, 54].
The main type of learning tested on kidney tissue is the supervised kind, where models are fit on training data consisting of inputs and usually expert-labeled outputs. This approach relies on large sets of labeled image data, and is feasible when data sets come from institutions where pathologists manually annotate a certain number of slides for algorithm training. However, it becomes time-consuming, subject to occasional disagreement between pathologists, and difficult to apply when large amounts of data are required (e.g. for more complex tasks like the classification of overlapping features in glomerular lesions). For this reason, hybrid AI approaches in nephropathology, which adopt a large number of unlabeled images, have been tested [55, 56]. Despite being a largely unexplored field in pathology, our analysis shows an increase in interest in the application in the last 2 years. Recent approaches include self-supervised learning, where a model is trained on an auxiliary task for which ground-truth is available for free and web image mining, where large-scale unannotated images are achieved through online resources [15]. To overcome the difficulties of accessing and transmitting large amounts of data, a federated-learning model has been proposed for decentralized training [57, 58] (Fig. 4).
The rapidly increasing trend in digital nephropathology is poised to create new challenges and opportunities that will shape its future. With regard to computer vision and its application as machine learning in pathology, the development of standardized datasets will be critical for advancing research in nephropathology [59]. These datasets should be diverse and include a range of rare diseases to increase sample size and improve the accuracy of classifiers. While supervised training methods may be costly and time-consuming, semi-supervised or unsupervised methods may offer a more efficient approach by allowing architectures to find tissue representations better suited for the task at hand [60]. Incorporating clinical data into these datasets will also enhance the accuracy of classifiers. Furthermore, combining AI with other technologies such as biomarker discovery and "omics" will likely uncover new insights and improve diagnosis and treatment for patients with kidney disease, especially in an “in situ” approach [61]. A multi-dimensional view of tissue samples and precise extraction of molecular features are enhanced by WSI, especially in techniques such as matrix-assisted laser desorption/ionization, multiplex immunohistochemistry and digital spatial profiling, the former showing promising results in the non-neoplastic kidney like amyloid characterization or biomarker discovery in membranous nephropathy [62, 63].
Conclusions
In the past 7 years, interest in nephropathology has exploded. This trend is expected to continue, and may revolutionize how nephrologists and pathologists approach kidney biopsy (Fig. 5). The unique complexities of nephropathology make it an excellent testing ground for various AI approaches that can create generalizable models for other research fields. With increasing computational capabilities and resources, solutions that integrate learning from multiple histochemical stains and histological structures, and consolidate different tasks, are being developed with decreasing reliance on human teaching.
References
L’Imperio V, Brambilla V, Cazzaniga G et al (2021) Digital pathology for the routine diagnosis of renal diseases: a standard model. J Nephrol 34:681–688. https://doi.org/10.1007/s40620-020-00805-1
Niazi MKK, Parwani AV, Gurcan MN (2019) Digital pathology and artificial intelligence. Lancet Oncol 20:e253–e261. https://doi.org/10.1016/S1470-2045(19)30154-8
Wilson PC, Messias N (2022) How whole slide imaging and machine learning can partner with renal pathology. Kidney 360(3):413–415
Yao L, Zhang H, Zhang M et al (2021) Application of artificial intelligence in renal disease. Clin eHealth 4:54–61. https://doi.org/10.1016/j.ceh.2021.11.003
Maayan C, Zajicek G, Rosenmann E (1979) Computer image analysis of kidney histopathological sections. Int J Biomed Comput 10:23–28. https://doi.org/10.1016/0020-7101(79)90039-4
D’Agati VD, Mengel M (2013) The rise of renal pathology in nephrology: structure illuminates function. Am J Kidney Dis 61:1016–1025. https://doi.org/10.1053/j.ajkd.2012.12.019
Maness HTD, Behar-Horenstein LS, Clare-Salzler M, Chamala S (2020) Informatics training for pathology practice and research in the digital era. Acad Pathol 7:2374289520911179. https://doi.org/10.1177/2374289520911179
Cathro HP, Shen SS, Truong LD (2018) Diagnostic histochemistry in medical diseases of the kidney. Semin Diagn Pathol 35:360–369. https://doi.org/10.1053/j.semdp.2018.10.001
Jiang L, Chen W, Dong B et al (2021) A deep learning-based approach for glomeruli instance segmentation from multistained renal biopsy pathologic images. Am J Pathol 191:1431–1441. https://doi.org/10.1016/j.ajpath.2021.05.004
Zhang L, Li M, Wu Y et al (2022) Classification of renal biopsy direct immunofluorescence image using multiple attention convolutional neural network. Comput Methods Programs Biomed 214:106532. https://doi.org/10.1016/j.cmpb.2021.106532
Kumar N, Gupta R, Gupta S (2020) Whole slide imaging (WSI) in pathology: current perspectives and future directions. J Digit Imaging 33:1034–1040. https://doi.org/10.1007/s10278-020-00351-z
Girolami I, Pantanowitz L, Marletta S et al (2022) Artificial intelligence applications for pre-implantation kidney biopsy pathology practice: a systematic review. J Nephrol 35:1801–1808. https://doi.org/10.1007/s40620-022-01327-8
Stroup DF, Berlin JA, Morton SC et al (2000) Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis of observational studies in epidemiology (MOOSE) group. JAMA 283:2008–2012. https://doi.org/10.1001/jama.283.15.2008
Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A (2016) Rayyan-a web and mobile app for systematic reviews. Syst Rev 5:210. https://doi.org/10.1186/s13643-016-0384-4
Yao T, Lu Y, Long J et al (2022) Glo-in-one: holistic glomerular detection, segmentation, and lesion characterization with large-scale web image mining. J Med Imaging (Bellingham) 9:052408. https://doi.org/10.1117/1.JMI.9.5.052408
Bouteldja N, Klinkhammer BM, Schlaich T et al (2022) Improving unsupervised stain-to-stain translation using self-supervision and meta-learning. J Pathol Inform 13:100107. https://doi.org/10.1016/j.jpi.2022.100107
Mascolini A, Cardamone D, Ponzio F et al (2022) Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations. BMC Bioinform 23:295. https://doi.org/10.1186/s12859-022-04845-1
Murphy M, Jegelka S, Fraenkel E (2022) Self-supervised learning of cell type specificity from immunohistochemical images. Bioinformatics 38:i395–i403. https://doi.org/10.1093/bioinformatics/btac263
Lee J, Warner E, Shaikhouni S et al (2022) Unsupervised machine learning for identifying important visual features through bag-of-words using histopathology data from chronic kidney disease. Sci Rep 12:4832. https://doi.org/10.1038/s41598-022-08974-8
Sato N, Uchino E, Kojima R et al (2021) Evaluation of kidney histological images using unsupervised deep learning. Kidney Int Rep 6:2445–2454. https://doi.org/10.1016/j.ekir.2021.06.008
Gadermayr M, Gupta L, Appel V et al (2019) Generative adversarial networks for facilitating stain-independent supervised and unsupervised segmentation: a study on kidney histology. IEEE Trans Med Imaging 38:2293–2302. https://doi.org/10.1109/TMI.2019.2899364
Barisoni L, Gimpel C, Kain R et al (2017) Digital pathology imaging as a novel platform for standardization and globalization of quantitative nephropathology. Clin Kidney J 10:176–187. https://doi.org/10.1093/ckj/sfw129
Park S, Parwani AV, Aller RD et al (2013) The history of pathology informatics: a global perspective. J Pathol Inform 4:7. https://doi.org/10.4103/2153-3539.112689
Trends in pathology informatics. In: Default. https://criticalvalues.org/news/all/2022/08/24/trends-in-pathology-informatics. Accessed 17 Dec 2022
Romberg D, Strohmenger K, Jansen C et al (2022) EMPAIA app interface: an open and vendor-neutral interface for AI applications in pathology. Comput Methods Programs Biomed 215:106596. https://doi.org/10.1016/j.cmpb.2021.106596
L’Imperio V, Casati G, Cazzaniga G et al (2023) Improvements in digital pathology equipment for renal biopsies: updating the standard model. J Nephrol. https://doi.org/10.1007/s40620-023-01568-1
Wilbur DC, Smith ML, Cornell LD et al (2021) Automated identification of glomeruli and synchronised review of special stains in renal biopsies by machine learning and slide registration: a cross-institutional study. Histopathology 79:499–508. https://doi.org/10.1111/his.14376
Kannan S, Morgan LA, Liang B et al (2019) Segmentation of glomeruli within trichrome images using deep learning. Kidney Int Rep 4:955–962. https://doi.org/10.1016/j.ekir.2019.04.008
Marsh JN, Matlock MK, Kudose S et al (2018) Deep learning global glomerulosclerosis in transplant kidney frozen sections. IEEE Trans Med Imaging 37:2718–2728. https://doi.org/10.1109/TMI.2018.2851150
Ginley B, Lutnick B, Jen K-Y et al (2019) Computational segmentation and classification of diabetic glomerulosclerosis. J Am Soc Nephrol 30:1953–1967. https://doi.org/10.1681/ASN.2018121259
Jayapandian CP, Chen Y, Janowczyk AR et al (2021) Development and evaluation of deep learning-based segmentation of histologic structures in the kidney cortex with multiple histologic stains. Kidney Int 99:86–101. https://doi.org/10.1016/j.kint.2020.07.044
Kers J, Bülow RD, Klinkhammer BM et al (2022) Deep learning-based classification of kidney transplant pathology: a retrospective, multicentre, proof-of-concept study. Lancet Digit Health 4:e18–e26. https://doi.org/10.1016/S2589-7500(21)00211-9
Bayramoglu N, Kaakinen M, Eklund L, Heikkilä J (2017) Towards virtual H&E staining of hyperspectral lung histology images using conditional generative adversarial networks. In: 2017 IEEE international conference on computer vision workshops (ICCVW). pp 64–71
Rivenson Y, Liu T, Wei Z et al (2019) PhaseStain: the digital staining of label-free quantitative phase microscopy images using deep learning. Light Sci Appl 8:23. https://doi.org/10.1038/s41377-019-0129-y
Rivenson Y, Wang H, Wei Z et al (2019) Virtual histological staining of unlabelled tissue-autofluorescence images via deep learning. Nat Biomed Eng 3:466–477. https://doi.org/10.1038/s41551-019-0362-y
Zhang Y, de Haan K, Rivenson Y et al (2020) Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissue. Light Sci Appl 9:78. https://doi.org/10.1038/s41377-020-0315-y
de Haan K, Zhang Y, Zuckerman JE et al (2021) Deep learning-based transformation of H&E stained tissues into special stains. Nat Commun 12:4884. https://doi.org/10.1038/s41467-021-25221-2
Loupy A, Haas M, Roufosse C et al (2020) The Banff 2019 Kidney Meeting Report (I): updates on and clarification of criteria for T cell- and antibody-mediated rejection. Am J Transplant 20:2318–2331. https://doi.org/10.1111/ajt.15898
Jeong HJ (2020) Diagnosis of renal transplant rejection: Banff classification and beyond. Kidney Res Clin Pract 39:17–31. https://doi.org/10.23876/j.krcp.20.003
Loupy A, Mengel M, Haas M (2022) Thirty years of the International Banff Classification for Allograft Pathology: the past, present, and future of kidney transplant diagnostics. Kidney Int 101:678–691. https://doi.org/10.1016/j.kint.2021.11.028
Farris AB, Moghe I, Wu S et al (2020) Banff Digital Pathology Working Group: going digital in transplant pathology. Am J Transplant 20:2392–2399. https://doi.org/10.1111/ajt.15850
Hermsen M, Ciompi F, Adefidipe A et al (2022) Convolutional neural networks for the evaluation of chronic and inflammatory lesions in kidney transplant biopsies. Am J Pathol 192:1418–1432. https://doi.org/10.1016/j.ajpath.2022.06.009
Yi Z, Salem F, Menon MC et al (2022) Deep learning identified pathological abnormalities predictive of graft loss in kidney transplant biopsies. Kidney Int 101:288–298. https://doi.org/10.1016/j.kint.2021.09.028
Choi G, Kim Y-G, Cho H et al (2020) Automated detection algorithm for C4d immunostaining showed comparable diagnostic performance to pathologists in renal allograft biopsy. Mod Pathol 33:1626–1634. https://doi.org/10.1038/s41379-020-0529-9
Ozyoruk KB, Can S, Darbaz B et al (2022) A deep-learning model for transforming the style of tissue images from cryosectioned to formalin-fixed and paraffin-embedded. Nat Biomed Eng 6:1407–1419. https://doi.org/10.1038/s41551-022-00952-9
Büllow RD, Marsh JN, Swamidass SJ et al (2022) The potential of artificial intelligence-based applications in kidney pathology. Curr Opin Nephrol Hypertens 31:251–257. https://doi.org/10.1097/MNH.0000000000000784
Nicholson ML, Bailey E, Williams S et al (1999) Computerized histomorphometric assessment of protocol renal transplant biopsy specimens for surrogate markers of chronic rejection. Transplantation 68:236–241. https://doi.org/10.1097/00007890-199907270-00013
Servais A, Meas-Yedid V, Buchler M et al (2007) Quantification of interstitial fibrosis by image analysis on routine renal biopsy in patients receiving cyclosporine. Transplantation 84:1595–1601. https://doi.org/10.1097/01.tp.0000295749.50525.bd
Moon A, Smith GH, Kong J et al (2018) Development of CD3 cell quantitation algorithms for renal allograft biopsy rejection assessment utilizing open source image analysis software. Virchows Arch 472:259–269. https://doi.org/10.1007/s00428-017-2260-6
Furness PN, Levesley J, Luo Z et al (1999) A neural network approach to the biopsy diagnosis of early acute renal transplant rejection. Histopathology 35:461–467. https://doi.org/10.1046/j.1365-2559.1999.035005461.x
Bueno G, Fernandez-Carrobles MM, Gonzalez-Lopez L, Deniz O (2020) Glomerulosclerosis identification in whole slide images using semantic segmentation. Comput Methods Programs Biomed 184:105273. https://doi.org/10.1016/j.cmpb.2019.105273
Hermsen M, de Bel T, den Boer M et al (2019) Deep Learning-Based Histopathologic Assessment of Kidney Tissue. J Am Soc Nephrol 30:1968–1979. https://doi.org/10.1681/ASN.2019020144
Chagas P, Souza L, Araújo I et al (2020) Classification of glomerular hypercellularity using convolutional features and support vector machine. Artif Intell Med 103:101808. https://doi.org/10.1016/j.artmed.2020.101808
Pesce F, Albanese F, Mallardi D et al (2022) Identification of glomerulosclerosis using IBM Watson and shallow neural networks. J Nephrol 35:1235–1242. https://doi.org/10.1007/s40620-021-01200-0
Ginley B, Tomaszewski JE, Yacoub R et al (2017) Unsupervised labeling of glomerular boundaries using Gabor filters and statistical testing in renal histology. J Med Imaging (Bellingham) 4:021102. https://doi.org/10.1117/1.JMI.4.2.021102
Gadermayr M, Eschweiler D, Jeevanesan A et al (2017) Segmenting renal whole slide images virtually without training data. Comput Biol Med 90:88–97. https://doi.org/10.1016/j.compbiomed.2017.09.014
Lutnick B, Manthey D, Becker JU et al (2022) A tool for federated training of segmentation models on whole slide images. J Pathol Inform 13:100101. https://doi.org/10.1016/j.jpi.2022.100101
Lu MY, Chen RJ, Kong D et al (2022) Federated learning for computational pathology on gigapixel whole slide images. Med Image Anal 76:102298. https://doi.org/10.1016/j.media.2021.102298
Yang Y, Sun K, Gao Y et al (2022) Preparing data for pathological artificial intelligence with clinical-grade performance. arXiv [eess.IV]
Montezuma D, Oliveira SP, Neto PC et al (2023) Annotating for artificial intelligence applications in digital pathology: a practical guide for pathologists and researchers. Mod Pathol 36:100086. https://doi.org/10.1016/j.modpat.2022.100086
Smith A, L’Imperio V, Ajello E et al (2017) The putative role of MALDI-MSI in the study of membranous nephropathy. Biochim Biophys Acta Proteins Proteom 1865:865–874. https://doi.org/10.1016/j.bbapap.2016.11.013
Bindi G, Smith A, Oliveira G et al (2023) Spatial resolution of renal amyloid deposits through MALDI-MSI: a combined digital and molecular approach to monoclonal gammopathies. J Clin Pathol. https://doi.org/10.1136/jcp-2023-208790
L’Imperio V, Smith A, Chinello C et al (2016) Proteomics and glomerulonephritis: a complementary approach in renal pathology for the identification of chronic kidney disease related markers. Proteomics Clin Appl 10:371–383. https://doi.org/10.1002/prca.201500075
Siller M, Stangassinger LM, Kreutzer C et al (2022) On the acceptance of “fake” histopathology: a study on frozen sections optimized with deep learning. J Pathol Inform 13:6. https://doi.org/10.4103/jpi.jpi_53_21
Becker JU, Mayerich D, Padmanabhan M et al (2020) Artificial intelligence and machine learning in nephropathology. Kidney Int 98:65–75. https://doi.org/10.1016/j.kint.2020.02.027
Funding
Open access funding provided by Università degli Studi di Milano - Bicocca within the CRUI-CARE Agreement. The work has been funded by the European Union-Next Generation EU-NRRP M6C2-Investment 2.1 Enhancement and strengthening of biomedical research in the NHS (DIPLOMAT-PNRR-MR1-2022-12375735), Regione Lombardia, regional law n° 9/2020, resolution n° 3776/2020, Ricerca Finalizzata GR-2021-12374235.
Author information
Authors and Affiliations
Contributions
GC, MR, AE and FP defined the study design; IG performed the data collection; GC and MR performed the literature review; GC, MR and VL performed the data analysis and interpretation; HVN, JUB and MGBG critically revised the paper, AE, MS, APDT, GG and FP provided the funding acquisition and administrative support. All authors were involved in writing the paper and had final approval of the submitted and published versions.
Corresponding author
Ethics declarations
Conflict of interest
The authors do not have any conflict of interest to declare.
Ethical approval
Approval was obtained from the local ethics committee (PNRR-MR1-2022-12375735, 03/16/23).
Human and animal rights
This article does not contain any studies involving human participants or animals performed by any of the authors.
Informed consent
For this type of study formal consent is not required.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Cazzaniga, G., Rossi, M., Eccher, A. et al. Time for a full digital approach in nephropathology: a systematic review of current artificial intelligence applications and future directions. J Nephrol 37, 65–76 (2024). https://doi.org/10.1007/s40620-023-01775-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40620-023-01775-w