Abstract
Histological assessment of autoimmune hepatitis (AIH) is challenging. As one of the possible results of these challenges, nonclassical features such as bile-duct injury stays understudied in AIH. We aim to develop a deep learning tool (artificial intelligence for autoimmune hepatitis [AI(H)]) that analyzes the liver biopsies and provides reproducible, quantifiable, and interpretable results directly from routine pathology slides. A total of 123 pre-treatment liver biopsies, whole-slide images with confirmed AIH diagnosis from the archives of the Institute of Pathology at University Hospital Basel, were used to train several convolutional neural network models in the Aiforia artificial intelligence (AI) platform. The performance of AI models was evaluated on independent test set slides against pathologist’s manual annotations. The AI models were 99.4%, 88.0%, 83.9%, 81.7%, and 79.2% accurate (ratios of correct predictions) for tissue detection, liver microanatomy, necroinflammation features, bile duct damage detection, and portal inflammation detection, respectively, on hematoxylin and eosin-stained slides. Additionally, the immune cells model could detect and classify different immune cells (lymphocyte, plasma cell, macrophage, eosinophil, and neutrophil) with 72.4% accuracy. On Sirius red-stained slides, the test accuracies were 99.4%, 94.0%, and 87.6% for tissue detection, liver microanatomy, and fibrosis detection, respectively. Additionally, AI(H) showed bile duct injury in 81 AIH cases (68.6%). The AI models were found to be accurate and efficient in predicting various morphological components of AIH biopsies. The computational analysis of biopsy slides provides detailed spatial and density data of immune cells in AIH landscape, which is difficult by manual counting. AI(H) can aid in improving the reproducibility of AIH biopsy assessment and bring new descriptive and quantitative aspects to AIH histology.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Autoimmune hepatitis (AIH) is a chronic, immune-mediated, and progressive inflammatory rare liver disease, and diagnosis frequency is increasing worldwide [1]. Liver histology plays a critical role in diagnosis and is considered mandatory in the diagnostic protocols [2,3,4]. However, the numerous challenges associated with liver biopsy interpretation, including low inter-observer agreement, disease heterogeneity, and lack of specific histological features, impact accurate and consistent characterization of histology [5]. No specific histological feature exists for diagnosing AIH [6]. The histological features of AIH primarily include elementary lesions typically observed in various forms of chronic hepatitis [7]. Moreover, some studies have demonstrated in liver biopsies of AIH the presence of non-classical microscopic features, such as bile duct injury [8]. However, as these features have not been extensively studied, their prevalence and significance remain unclear. Thus, an effective AIH-focused image analysis tool to detect these relevant elementary lesions in chronic hepatitis biopsies is needed.
Artificial intelligence (AI) tools using convolutional neural networks (CNN) have demonstrated potential applications in medical imaging and pathological diagnostics [9]. Despite CNN’s promising performance in classification, detection, and quantification, usage of deep learning in clinical practice has not yet been adapted owing to its lack of interpretability [10,11,12]. Pathologists prefer clear declarative representations from AI models that they can perceive and comprehend in order to determine their decision boundaries [10]. It has been shown that the diagnostic performance of a pathologist is improved when they have visual output overlay of AI model’s predictions along with slide images [13]. Machine learning algorithms have been used in clinical prediction models with higher diagnostic accuracy for several liver diseases [14]. Furthermore, integrating and combining AI with digital pathology may reduce inter-observer variability [15, 16]. The multilayered complex landscape of AIH histology requires a hand-crafted pipeline. Instead of having a characteristic specific lesion (e.g., a ground-glass cell for HBV hepatitis [17] or a ballooning cell for steatohepatitis) [18], AIH biopsies have histological features of chronic hepatitis. This requires detection of various inflammation features, which are distinguished from each other by their locations and extensions. Therefore, we built a fully supervised multilayered pipeline by combining different computer vision models to achieve detection of various chronic hepatitis features.
This study aims to develop the first ever deep-learning AI tool (artificial intelligence for hepatitis, AI[H]) that evaluates and classifies different regions of AIH histology to provide a granular, quantifiable, and reproducible analysis of AIH pathology.
Patients and methods
Patient cohort and liver biopsies
A total of 123 pre-treatment liver biopsies from 116 anonymized adult patients with AIH, collected between 1996 and 2020, were selected from the archives of Institute of Pathology at University Hospital Basel, Basel, Switzerland. The diagnosis of AIH was confirmed according to current European Association for the Study of the Liver guidelines [19]. Patients who received a diagnosis of any other liver disease along with AIH at the time of diagnosis or during follow-up were excluded from the study. For the exploration of performance on other hepatitis samples, two liver biopsies with acute hepatitic histologic pattern drug-induced liver injury, four HBV hepatitis biopsies, and five HCV biopsies were scanned and analyzed by the trained model. Visual inspections were conducted to assess the results.
Written informed consent was obtained from all patients included in the study. The study protocol conformed to the ethical guidelines of the Swiss Federal Human Research Act (key ethical guidelines of January 2014) and was approved by the Ethics Committee of Northwestern Switzerland (authorization number: EKNZ 2014–362).
Liver biopsies
Microscopical evaluation of samples
Hematoxylin and eosin (H&E) and Sirius red-stained slides from the University Hospital Basel Institute of Medical Genetics and Pathology’s biobank were used. Two experienced pathologists concurrently assessed the liver biopsies using a multiheaded microscope and employed the Ishak scoring system, a well-established framework for grading necro-inflammatory activity and fibrosis in chronic hepatitis histology [20], and consensus recommendations for histological criteria of AIH from the International AIH Pathology Group [6]. This collaborative approach ensured accurate and consistent evaluations, with the final scores representing the agreed-upon assessments by both pathologists.
Imaging and software
The digital whole-slide images (WSIs) of H&E-stained liver tissue needle biopsies were scanned at a magnification equivalent to 40 × objective with a Pannoramic SCAN II scanner and software (3DHISTECH™, Hungary) which produces a final digital slide with 0.24 µm/px resolution, and these slides were used for AI model development. The WSIs were uploaded to the Aiforia platform (Aiforia Technologies Plc, Helsinki, Finland), featuring deep learning and cloud-based image analysis technology.
Convolutional neural networks training: creating AI models via supervised learning
Models were trained using the Aiforia research cloud platform on WSIs. To develop the AI models, biopsies were randomly split into training (80%) and test (20%) datasets. Separate CNN-based AI models were used to predict different components of histological images, each focusing on a different feature of AIH pathology. H&E slides were used to train the CNNs for semantic segmentation and object-based detection of main liver microanatomy, hepatitis morphology, immune cells, and bile duct damage. The fibrosis grading model was trained using Sirius red slides. Training and test dataset annotations for the immune cell classification models were performed by two pathologists on digital slides; the rest of the annotations were performed by a single pathologist.
The liver microanatomy detection model was trained to segment liver tissue into portal area, lobular area, and central vein compartments. The necro-inflammation model was trained to identify focal necrosis, interface hepatitis, and confluent necrosis. The immune cell classification model was designed to detect, classify, and quantify five types of immune cells including lymphocytes, plasma cells, macrophages, eosinophils, and neutrophils, along with acidophil bodies. In the slides of the training dataset, representative morphological areas were selected for annotation (Fig. 1). Of the total training data set of images, a variable area per class was used for training. Table 1 provides the details for annotating the different image features in the training material (99 WSIs).
Evaluation of model performance
The validation was conducted through a pixel-level assessment, where AI models were evaluated on an independent test (validation) dataset comprising slides with pathologist’s manual annotations. This pixel-based evaluation aimed to assess the generalization capability of the models for future datasets, ensuring their robustness and accuracy in capturing histological features. Classification metrics, such as overall accuracy, macro-precision, and macro-sensitivity (macro-recall), were used to evaluate the performance of AI models. Accuracy was defined as the number of correct predictions divided by the total number of evaluations. Precision was calculated as TP/(TP + FP), and sensitivity was computed as TP/(TP + FN), where TP, FP, and FN are the number of true positives, false positives, and false negatives, respectively. In multiclass classification, each category forms its own positive class and combines other categories as the negative class, thus rendering several binary classifications. Macro-precision and macro-sensitivity are presented as arithmetic mean of individual binary precisions and of individual binary sensitivities, respectively. The performance metrics were calculated using the Aiforia platform.
The visualization and statistical analysis of quantification data output were performed using R (version 3.6.3). For data processing, the dplyr package was utilized, while data plotting was carried out using ggplot2. Confusion matrix statistical analysis was conducted using the caret package, and confusion matrix visualization was achieved with the cvsm package. Statistical analysis was performed using ggpubr. The p values were calculated using Student’s t test.
Results
The biopsy slides of 116 patients (94 women and 22 men; mean age 59 years) were utilized. Two patients were biopsied twice at different time points before the treatment; therefore, 118 biopsies were used in the study. The biopsy material was split and embedded into two blocks for five biopsies; therefore, more than one slide was available for these biopsies. Overall, a total of 123 pairs of H&E- and Sirius red-stained AIH pre-treatment biopsy slides were included in the study.
Biopsy slides of patients were randomly assigned to training (n = 99) and test (n = 24) datasets. Baseline characteristics for the patients who provided biopsies were balanced between the training and test data sets (Table 2).
The pipeline for identification of AIH histology and model performance
To achieve the detection of AIH-related changes in liver biopsies, we developed a deep learning pipeline that consists of multiple deep learning models for different structures, features, and staining. A list of the final AI models with their layer structure and classes is presented in Table S1. Image analyses were run on the training and test set slides using the respective AI models. The models gave high test accuracies when evaluated on the separate test dataset (Tables 3 and 4).
We began with the segmentation of whole liver tissue area against background space. The tissue segmentation (foreground vs background) models showed excellent performance for both H&E- and Sirius red-stained slides, with over 99.4% accuracy. Following this, we set up semantic segmentation AI models for liver microanatomy which segments liver tissue into parenchyma, portal area, and central vein regions (Fig. 2). The pixel-level accuracy of the H&E model was 88.0% (Table 3), while that of Sirius red was 94.0% (Table 4).
We trained necroinflammation models on H&E slides to detect and classify elementary lesions of hepatitis such as interface hepatitis, focal necrosis, focal confluent necrosis, perivenular necrosis, bridging necrosis, and panacinar necrosis classes (Fig. 2). The overall accuracy of the necroinflammation segmentation model was 83.9% (Table 3). However, errors in the predictions mostly stemmed from lesions that were correctly classified but did not perfectly align with the ground truth annotations (Sup. Figure 1A-B). The portal inflammation model first detected the portal regions with inflammation, then consecutively graded them in a three-tier system: mild, moderate, and severe portal inflammation. The model had 79.2% accuracy (Table 3).
The immune cell classification model was designed to detect, classify, and quantify lymphocytes, plasma cells, macrophages, eosinophils, neutrophils, along with acidophil bodies (Fig. 2). To train and test the network, a total of 7868 annotations of immune cells were generated across all the datasets. The model accuracy rate for detection and classification of the immune cells was 72.4% (Table 3, Sup. Table 1). However, errors were observed primarily in densely inflamed regions, where the individual immune cell borders could not be easily differentiated (Sup Fig. 1C). Bile duct injury model detects and classifies bile ducts into “normal” and “damaged” categories. Bile duct injury was described as epithelial infiltration by mononuclear inflammatory cells, epithelial damage, and malformed, tortuous or irregularly shaped bile ducts (Fig. 3A) [8]. The accuracy of the model was 81.7% in the test dataset (Table 3). The result of the model showed that 69.5% (66/95) training set biopsies and 65.2% (15/23) test set biopsies (68.6% overall) had bile duct damage.
Fibrosis-related features were trained and tested on Sirius red-stained slides. The fibrosis model consists of portal fibrosis, perivenular fibrosis, pericellular fibrosis, bridging fibrosis, nodular fibrosis, and cirrhosis classes (Fig. 3B). Portal areas without fibrosis were left in the background. The overall accuracy of the model was 88.0%. While the model’s predictions often showed decent alignment with the ground truth annotations, errors in both the detection and classification of fibrotic lesions were observed in some regions (Sup Fig. 1D).
To get a deeper insight of AIH pathology, several AI models were combined to observe unique features together. For example, the combination of the necro-inflammation and bile duct models is shown in Fig. 2. The visual overlay output can assist pathologist for detection of particular lesions or evaluating the spatial relationship to detect the hotspot regions.
Quantitative analysis of AI(H) predictions: comparison with pathologists’ evaluation
We conducted an additional analysis to further explore the utility of the AI-based image analysis tool. This analysis aimed to investigate the potential correlation between the AI(H) predictions and the pathologists’ assessments in terms of histological grading and staging of AIH biopsies. Quantification data obtained from the computational analysis were exported and compared among different grading feature groups as determined by the pathologists’ evaluations.
For focal necrosis, we compared the maximum count of focal necrosis in 4 µm2 between different focal necrosis scores (0–4 according to the Ishak scoring system). The results from AI(H) demonstrated a clear increase in focal necrosis counts with higher focal necrosis scores (Fig. 4A). Additionally, we observed a concurrent increase in immune cell density in the liver parenchyma for five different cell types along with focal necrosis counts (Fig. 4B).
In the case of interface hepatitis, we analyzed the maximum ratio of the length of the portal area to the circumference of the portal area for each biopsy, based on interface hepatitis scores. To calculate the circumference of the portal area affected by interface hepatitis, we utilized the portal area predictions from the microanatomy model as the denominator of the calculation. Our findings revealed a consistent increase in the ratio with higher interface hepatitis scores, as demonstrated by the AI(H) results (Fig. 4C). Similarly, the immune cell density in the portal area for the five cell types showed a noticeable increase corresponding to the severity of interface hepatitis (Fig. 4D).
Lastly, we investigated portal inflammation by comparing the moderate level portal inflammation ratio between different portal inflammation scores (0–4 according to the Ishak scoring system). The AI(H) predictions exhibited an incremental pattern with increasing portal inflammation scores (Fig. 4E). Furthermore, the immune cell density in the portal area for the five cell types exhibited a parallel increase in relation to portal inflammation scores (Fig. 4F).
The results of this comparative analysis provide insights into the concordance between AI-based predictions and expert pathologists’ evaluations, thereby highlighting the potential clinical value of AI(H) in enhancing the accuracy and consistency of AIH assessment.
Utilization of AI(H) outputs for AIH histopathology assessment
We explored the potential of model’s quantification outputs for stratifying liver biopsies according to the latest consensus recommendations for histological criteria of AIH from the International AIH Pathology Group [6]. Among the samples analyzed, the 29/119 (24.4%) exhibited a “Portal hepatitis pattern” (Sup. Figure 2A). All the portal hepatitis samples showed either lobular hepatitis or interface hepatitis, thus 29/29 (100%) were classified in the likely category. On the other hand, 90/119 (76.6%) of biopsies were classified as “Lobular hepatitis pattern” (Sup. Figure 2A). Among these, 74/90 (82.2%) samples demonstrated the presence of at least one of the following: interface hepatitis, portal fibrosis, or lymphoplasmacytic inflammation, classifying them as likely for AIH, while 19/90 (17.8%) biopsies within the lobular hepatitis category were considered possible for AIH.
Subsequently, we compared the predictions of AI(H) against the pathologist’s diagnosis based on the latest consensus recommendations for histological criteria of AIH. The predictions of AI(H) showed 88.2% accuracy in classifying AIH biopsies into “likely” and “possible” categories (Supplementary Fig. 2B). Misclassification within the “likely” category was primarily due to overdiagnosis of interface hepatitis, indicating potential for improvement in feature differentiation (Supplementary Fig. 2C). Conversely, misclassification in these samples was also influenced by factors like discoloration from long archive time and severe parenchymal necrosis, underscoring the importance of sample quality for accurate AI-based diagnosis (Supplementary Fig. 2D). Collectively, these results demonstrate potential use cases of the quantification output of AI(H) in pathologist’s evaluations.
While the AI(H) model has not been trained to identify features suggestive of other liver diseases, nor has it been systematically validated for clinical diagnosis performance, it is suboptimal for this purpose. Nonetheless, our experiment illustrates its versatility in providing quantification data for various applications.
Detection of chronic hepatitis features in non-AIH liver biopsies by AI(H)
In light of the similarities in elementary lesions observed in hepatitis biopsies, including focal necrosis and interface hepatitis, we explored the detection performance of AI(H) for chronic hepatitis features in samples diagnosed with other acute and chronic hepatitis conditions. Specifically, we examined liver biopsies diagnosed with drug-induced liver disease with acute lobular hepatitis and HCV- and HBV-chronic hepatitis.
While AI(H) was not initially developed for analyzing non-AIH liver biopsies, our observations reveal its capability to recognize hepatitis elementary lesions, such as focal necrosis, interface hepatitis, and portal fibrosis, alongside immune cells and bile duct damage (Supplementary Fig. 3). Although the model demonstrated decent performance across various tasks, we noted incidental errors, such as false bile duct damage classification in inflamed regions and underestimation of immune cells. Of particular note, while many interface hepatitis regions were detected correctly, some detections were smaller than the lesions themselves. Overall, these findings suggest that with fine-tuning using annotations for each disease, the model holds potential to be utilized in other liver diseases.
Discussions
The semi-quantitative manner of the AIH pathological assessment brings an inherent degree of inter- and intra-observer variability in AIH assessment. AI(H), a digital AI tool developed primarily for the granular quantification of biopsy images, serves to enhance the analysis process by providing precise, consistent, and rapid analysis of AIH histology While it can help ease the challenges faced by pathologists, it is essential to emphasize that AI(H) is intended as an adjunctive tool rather than a standalone diagnostic solution. In addition, it can provide precious quantification data from H&E slide analysis. Its primary function is to augment pathological analysis and offer valuable quantification data from H&E slide analysis, ultimately supporting but not replacing the expertise and clinical judgment of trained professionals.
While current advances in computational pathology of neoplastic diseases are producing positive findings, more challenging non-tumor pathologic diseases have, for the most part, been omitted owing to the complexity of diagnosis (i.e., clinical, laboratory, and histological features). There are an increasing number of studies in hepatology that use pathology slide images for AI-based model development [21]. The majority of the non-neoplastic studies are focused on non-alcoholic steatohepatitis [21], and only a few computational pathology studies are focused on other liver diseases, such as viral hepatitis [22], liver transplantation [23], and primary sclerosing cholangitis [24]. To our knowledge, this is the first AI tool developed for the analysis of AIH histology. The AIH immune ecosystem consists of a varying number of mostly chronic inflammatory cells whereby the frequency and alteration of certain immune cell types are related to disease activity and response to treatment. The computing capacity of AI provides a larger amount of information from biopsies that is not routinely possible by pathologist evaluation, such as identifying, categorizing, localizing, and counting large quantities of immune cells. Thus, AI opens new avenues for evaluation and quantification of liver inflammation.
An unmet need exists in hepatopathology for fast, reproducible, and quantitative diagnosis [25]. The AI(H) algorithm in our study accurately predicted key AIH components such as portal lymphoplasmacytic infiltrate, interface hepatitis, lobular activity, and fibrosis with high efficiency, in classifying and counting cells and tissues. To address the complex nature of AIH histology, a cascade of AI models targeted distinct challenging histological features. The AI(H) algorithm accurately identified key AIH features with high efficiency but faced challenges in immune cell detection. There can be several reasons for this: for immune cells, the training data are more noisy and not representative enough, the true effective sample size (not the number of training biopsy slides) is smaller, and the combined detection of classification task of single immune cells is more complicated. Hence, the accuracy for immune cells is lower than the accuracy for microanatomy. These models, targeting elementary lesions of chronic hepatitis, offer adaptability to other scoring systems (such as METAVIR [26]), potential future changes in AIH assessment [6], or the evaluation of other chronic hepatitis biopsies, [7] like viral hepatitis. Bile duct damage in AIH is acknowledged to be confusing, and most of the time it is an overlooked histological feature. Therefore, ambiguity of their significance remains unresolved. The presence of bile duct injury as an incidental histological feature in AIH was found in various proportions in the reported literature, such as 24%, [27], 72%,[28], and 83% [8]. AI(H) defined the proportion of biopsies with bile duct injury as 68.6% in our dataset, which is closer to Kuiper et al.’s result (72%) [28]. This discrepancy may stem from the changing AIH diagnosis criteria over time. With the leverage of AI-based image analysis approaches, the under-investigated fields of pathology could be revealed, and histological feature relationships could be elaborated.
Interpretability and visualization are important aspects in the computational pathology field. In clinical practice, pathologists can significantly benefit from the overlay of AI model’s predictions for their qualitative self-evaluation of the biopsies along with quantitative output. AI(H) makes pathologist-level evaluation of hepatitis and may be able to guide pathologists to disease specific features on biopsy images. However, this study faces limitations: it used biopsies solely from one institution, with annotations by a single pathologist; AIH liver biopsies with highly disrupted architecture or slides enriched with necro-inflammation reduced the accuracy of the AI model predictions. In addition, although the grading and staging of the liver biopsies are based evaluation of two pathologist, because the evaluations were set in evaluation and consensus of two pathologists, the effect of inter-observer variability could not be assessed in the study. While the AI(H) model has high accuracy, there were a few mislabeled features specific to areas where fibrosis staging was high. Additionally, only Sirius red-stained slides were used for the assessment of connective tissue stains for collagen and training the model for the fibrosis. Although the most recent consensus states that the method of choice depends on the experience and routine protocols established in each center, evaluation of elastic fiber staining (such as such as orcein, Victoria Blue or Elastic van Gieson) is important to distinguish recent collapse from longstanding fibrosis [6]. It would be beneficial of incorporation of an additional elastic fibrin staining in liver fibrosis assessment in future studies.
Since the diagnosis of AIH requires combination of microscopical finding along with clinical story and laboratory values, being a solely image-based analysis tool is a significant limitation for AI(H) for its diagnostic tool. Additionally, differential diagnosis of microscopical findings from other liver diseases is important aspect in AIH diagnosis. Exclusion of coexisting liver diseases limits the model’s real-world diagnostic applicability [29]. Moreover, the AI(H) model’s reliance solely on slide images, without clinical or lab data, restricts its capacity for comprehensive differential diagnosis. Future improvements necessitate a larger, diverse training set to enhance diagnostic accuracy and minimize misdiagnoses of other liver conditions as AIH. Calculating sensitivity and specificity using AI(H) is imperative for reliable clinical predictions. Additionally, multimodal AI models emerge for other fields of computational pathology for making mode precise predictions of patient prognosis by an integration of multiple patient information, such as pathology, radiology and genomic [30,31,32]. Similar study designs which combine pathology images, laboratory results, and patient history, could yield a diagnostic tool for AIH diagnosis.
AI(H) helps in classifying the different regions of AIH histology by providing a granular, quantifiable, and consistent analysis of AIH pathology. It was accurate and efficient in predicting various morphological components of AIH biopsies and has potential to aid in AIH microscopical assessment. The AI-based image analysis tool’s capacity to deliver reproducible and centralized results for biopsy evaluation makes it particularly valuable for clinical trials. This potential advantage constitutes a significant strength of the present study. However, AI(H) needs further studies to address this study’s limitations. In addition, the classical advantages of computational methods (e.g., high reproducibility, speed, and quantitative capabilities) make AI(H) a promising interpretable computational pathology tool to facilitate histological recognition in the era of augmented pathology.
Data availability
The data that support the findings of this study are available from the corresponding author upon reasonable request.
Abbreviations
- AIH:
-
Autoimmune hepatitis
- AI:
-
Artificial intelligence
- AI(H):
-
Artificial intelligence for autoimmune hepatitis
- CNN:
-
Convolutional neural networks
- FN:
-
False negative
- FP:
-
False positive
- H&E:
-
Hematoxylin and eosin
- TP:
-
The number of true positives
- WSI:
-
Whole-slide image
References
Grønbæk L, Vilstrup H, Jepsen P (2014) Autoimmune hepatitis in Denmark: incidence, prevalence, prognosis, and causes of death. A nationwide registry-based cohort study. J Hepatol 60(3):612–7. https://doi.org/10.1016/j.jhep.2013.10.020
EASL clinical practice guidelines (2015) autoimmune hepatitis. J Hepatol 63(4):971–1004. https://doi.org/10.1016/j.jhep.2015.06.030
Alvarez F, Berg PA, Bianchi FB, Bianchi L, Burroughs AK, Cancado EL et al (1999) International Autoimmune Hepatitis Group Report: review of criteria for diagnosis of autoimmune hepatitis. J Hepatol 31(5):929–938. https://doi.org/10.1016/s0168-8278(99)80297-9
Gleeson D, Heneghan MA (2011) British Society of Gastroenterology (BSG) guidelines for management of autoimmune hepatitis. Gut 60(12):1611–1629. https://doi.org/10.1136/gut.2010.235259
Winkfield B, Aube C, Burtin P, Cales P (2003) Inter-observer and intra-observer variability in hepatology. Eur J Gastroenterol Hepatol 15(9):959–966. https://doi.org/10.1097/00042737-200309000-00004
Lohse AW, Sebode M, Bhathal PS, Clouston AD, Dienes HP, Jain D et al (2022) Consensus recommendations for histological criteria of autoimmune hepatitis from the International AIH Pathology Group. Liver Int 42(5):1058–1069. https://doi.org/10.1111/liv.15217
Bianchi L (1983) Liver biopsy interpretation in hepatitis. Part I. Presentation of critical morphologic features used in diagnosis (glossary). Pathol Res Pract 178(1):2–19. https://doi.org/10.1016/S0344-0338(83)80080-6
Verdonk RC, Lozano MF, van den Berg AP, Gouw AS (2016) Bile ductal injury and ductular reaction are frequent phenomena with different significance in autoimmune hepatitis. Liver Int 36(9):1362–1369. https://doi.org/10.1111/liv.13083
Aggarwal R, Sounderajah V, Martin G, Ting DSW, Karthikesalingam A, King D et al (2021) Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis. NPJ Digit Med 4(1):65. https://doi.org/10.1038/s41746-021-00438-z
Zhang Z, Chen P, McGough M, Xing F, Wang C, Bui M et al (2019) Pathologist-level interpretable whole-slide cancer diagnosis with deep learning. Nat Mach Intell 1(5):236–245. https://doi.org/10.1038/s42256-019-0052-1
Lipton ZC (2018) The mythos of model interpretability. Commun ACM 61(10):36–43. https://doi.org/10.1145/3233231
Holzinger A, Biemann C, Pattichis CS, Kell DB (2017) What do we need to build explainable AI systems for the medical domain? arXiv. https://doi.org/10.48550/arXiv.1712.09923
Raciti P, Sue J, Ceballos R, Godrich R, Kunz JD, Kapur S et al (2020) Novel artificial intelligence system increases the detection of prostate cancer in whole slide images of core needle biopsies. Mod Pathol 33(10):2058–2066. https://doi.org/10.1038/s41379-020-0551-y
Ahn JC, Connell A, Simonetto DA, Hughes C, Shah VH (2021) Application of artificial intelligence for the diagnosis and treatment of liver diseases. Hepatology 73(6):2546–2563. https://doi.org/10.1002/hep.31603
Paradis V, Quaglia A (2019) Digital pathology, what is the future? J Hepatol 70(5):1016–1018. https://doi.org/10.1016/j.jhep.2018.03.023
Salto-Tellez M, Maxwell P, Hamilton P (2019) Artificial intelligence-the third revolution in pathology. Histopathology 74(3):372–376. https://doi.org/10.1111/his.13760
Bianchi L (1983) Liver biopsy interpretation in hepatitis. Part II: Histopathology and classification of acute and chronic viral hepatitis/differential diagnosis. Pathol Res Pract 178(2):180–213. https://doi.org/10.1016/S0344-0338(83)80032-6
Gramlich T, Kleiner DE, McCullough AJ, Matteoni CA, Boparai N, Younossi ZM (2004) Pathologic features associated with fibrosis in nonalcoholic fatty liver disease. Hum Pathol 35(2):196–199. https://doi.org/10.1016/j.humpath.2003.09.018
European Association for the Study of the L. EASL clinical practice guidelines: autoimmune hepatitis. J Hepatol. 2015;63(4):971–1004. https://doi.org/10.1016/j.jhep.2015.06.030
Ishak K, Baptista A, Bianchi L, Callea F, De Groote J, Gudat F et al (1995) Histological grading and staging of chronic hepatitis. J Hepatol 22(6):696–699. https://doi.org/10.1016/0168-8278(95)80226-6
Nam D, Chapiro J, Paradis V, Seraphin TP, Kather JN (2022) Artificial intelligence in liver diseases: improving diagnostics, prognostics and response prediction. JHEP Rep 4(4):100443. https://doi.org/10.1016/j.jhepr.2022.100443
Juyal D, Shukla C, Pokkalla H, Taylor A, Zevallos O, Resnick M et al (2020) Machine learning identifies histologic features associated with regression of cirrhosis in treatment for chronic hepatitis B. J Hepatol 73:S140–S141. https://doi.org/10.1016/S0168-8278(20)30791-1
He T, Fong JN, Moore LW, Ezeana CF, Victor D, Divatia M et al (2021) An imageomics and multi-network based deep learning model for risk assessment of liver transplantation for hepatocellular cancer. Comput Med Imaging Graph 89:101894. https://doi.org/10.1016/j.compmedimag.2021.101894
Sjoblom N, Boyd S, Manninen A, Knuuttila A, Blom S, Farkkila M et al (2021) Chronic cholestasis detection by a novel tool: automated analysis of cytokeratin 7-stained liver specimens. Diagn Pathol 16(1):41. https://doi.org/10.1186/s13000-021-01102-6
Calderaro J, Kather JN (2021) Artificial intelligence-based pathology for gastrointestinal and hepatobiliary cancers. Gut 70(6):1183–1193. https://doi.org/10.1136/gutjnl-2020-322880
Bedossa P, Poynard T (1996) An algorithm for the grading of activity in chronic hepatitis C. The METAVIR Cooperative Study Group Hepatol 24(2):289–293. https://doi.org/10.1002/hep.510240201
Czaja AJ, Carpenter HA (2001) Autoimmune hepatitis with incidental histologic features of bile duct injury. Hepatology 34(4 Pt 1):659–665. https://doi.org/10.1053/jhep.2001.27562
Kuiper EM, Zondervan PE, van Buuren HR (2010) Paris criteria are effective in diagnosis of primary biliary cirrhosis and autoimmune hepatitis overlap syndrome. Clin Gastroenterol Hepatol 8(6):530–534. https://doi.org/10.1016/j.cgh.2010.03.004
Ducazu O, Degroote H, Geerts A, Hoorens A, Schouten J, Van Vlierberghe H et al (2021) Diagnostic and prognostic scoring systems for autoimmune hepatitis: a review. Acta Gastroenterol Belg 84(3):487–495. https://doi.org/10.51821/84.3.014
Kong J, Cooper LA, Wang F, Gutman DA, Gao J, Chisolm C et al (2011) Integrative, multimodal analysis of glioblastoma using TCGA molecular data, pathology images, and clinical outcomes. IEEE Trans Biomed Eng 58(12):3469–3474. https://doi.org/10.1109/TBME.2011.2169256
Ding K, Zhou M, Metaxas DN, Zhang S (2023) Pathology-and-genomics multimodal transformer for survival outcome prediction. Medical Image Computing and Computer Assisted Intervention – MICCAI 2023. Lecture Notes in Computer Science, 622–31. https://doi.org/10.1007/978-3-031-43987-2_60
Vanguri RS, Luo J, Aukerman AT, Egger JV, Fong CJ, Horvat N et al (2022) Multimodal integration of radiology, pathology and genomics for prediction of response to PD-(L)1 blockade in patients with non-small cell lung cancer. Nat Cancer 3(10):1151–1164. https://doi.org/10.1038/s43018-022-00416-8
Acknowledgements
The authors would like to thank Nora Holmberg, Kristina Tarkiainen, Olivia Tapaninen, Emma Vaara, Sami Blom, and Christine Relander from Aiforia Technologies, and Sara Attianese from University Hospital Basel for their support. Medical writing support was provided by Lakshya Untwal, Megha Bansal (Novartis Healthcare Pvt. Ltd, Hyderabad, India) and Philip O’Gorman (Novartis Ireland Limited, Dublin, Ireland), which was funded by Novartis Pharma AG, Basel, Switzerland, in accordance with Good Publication Practice (GPP 2022) guidelines (http://www.ismpp.org/gpp-2022). Part of this study has been presented as a poster at the American Association for the Study of Liver Diseases—The Liver Meeting in 2021 and the European Congress of Pathology in 2022. All authors had control over the content of the manuscript and critically reviewed all drafts of the manuscript.
Funding
Open access funding provided by University of Basel. The study was partially funded by Novartis Pharma AG, Basel, Switzerland.
Author information
Authors and Affiliations
Contributions
Caner Ercan: conceptualization, methodology, resources, data curation, investigation, visualization, writing—original draft, review and editing; Kattayoun Kordy: conceptualization, writing—review and editing; Anna Knuuttila: methodology, data curation, investigation, writing—review and editing; Xiaofei Zhou: methodology, writing—review and editing; Darshan Kumar: software, methodology, investigation, visualization, writing—review and editing; Ville Koponen: data curation, writing—review and editing; Peter Mesenbrink: methodology, writing—review and editing; Serenella Eppenberger-Castori: resources, data curation, writing—review and editing; Parisa Amini: writing—review and editing; Marcos C. Pedrosa: supervision, funding acquisition, writing—review and editing; Luigi M Terracciano: supervision, writing—review and editing.
Corresponding author
Ethics declarations
Conflict of interest
Caner Ercan, Serenella Eppenberger-Castori, and Luigi M. Terracciano have no conflicts to declare. Anna Knuuttila and Darshan Kumar are employees and shareholders of Aiforia Technologies. Ville Koponen is associated with Aiforia Technologies, however, does not have any conflict of interest to declare. Xiaofei Zhou and Peter Mesenbrink are employees and shareholders of Novartis Pharmaceuticals Corporation, East Hanover, NJ, USA. Kattayoun Kordy was an employee and shareholder of Novartis Pharmaceuticals Corporation, East Hanover, NJ, USA. Parisa Amini is an employee of Novartis Pharma AG, Basel, Switzerland. Marcos C. Pedrosa was an employee and shareholder of Novartis Pharma AG, Basel, Switzerland.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Ercan, C., Kordy, K., Knuuttila, A. et al. A deep-learning-based model for assessment of autoimmune hepatitis from histology: AI(H). Virchows Arch (2024). https://doi.org/10.1007/s00428-024-03841-5
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00428-024-03841-5