Abstract
Medical imaging and diagnostics have benefited from recent advances in machine learning in general and deep learning in particular. There are a large number of studies that report significant performance in a variety of medical image analysis tasks. At the same time, advances in time series analysis of electronic health records and physiological signals from a variety of sources (including clinical and nonclinical wearable sensors) have enabled efficient clinical pipelines and diagnostic performance. While there are a large number of studies that report such advances and use cases, there is a certain level of resistance to clinical adaptability of such methods. We attribute one of the major reasons for this to be the black-box nature of such machine learning and data-driven models. While clinical decision-making, for example, using radiology, relies not only on radiographic information but also on clinical expertise (that could rely on clinical history of a patient as well as demographic information), such informed decision makes the backbone of clinical practice. Hence, machine learning should adapt to making such informed decisions for wider adaptability and finding more practical use cases. We argue that explainable methods, where a machine learning-based model provides supporting information for their decisions making them understandable, will be more representative of what is required in clinical practice. In turn, such methods would augment the current medical imaging and diagnosis pipeline and hence allow adaptation of artificial intelligence in clinical workflows. This would transform the healthcare industry with far-reaching benefits for both clinical practitioners and patients enabling precise and personalized medicine.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Feng Z, et al. Early prediction of disease progression in COVID-19 pneumonia patients with chest CT and clinical characteristics. Nat Commun. 2020;11(1):1–9.
Li X, et al. Multi-resolution convolutional networks for chest X-ray radiograph based lung nodule detection. Artif Intell Med. 2020;103:101744.
Rodriguez-Ruiz A, et al. Stand-alone artificial intelligence for breast cancer detection in mammography: comparison with 101 radiologists. JNCI: J Natl Cancer Inst. 2019;111(9):916–22.
Obermeyer Z, Emanuel EJ. Predicting the future – big data, machine learning, and clinical medicine. N Engl J Med. 2016;375(13):1216.
Menze BH, et al. The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging. 2014;34(10):1993–2024.
Zbontar J, et al. fastMRI: an open dataset and benchmarks for accelerated MRI. arXiv preprint arXiv:1811.08839, 2018.
Anwar SM, Majid M, Qayyum A, Awais M, Alnowami M, Khan MK. Medical image analysis using convolutional neural networks: a review. J Med Syst. 2018;42(11):1–13.
Qayyum A, Anwar SM, Awais M, Majid M. Medical image retrieval using deep convolutional neural network. Neurocomputing. 2017;266:8–20.
Hussain S, Anwar SM, Majid M. Segmentation of glioma tumors in brain using deep convolutional neural network. Neurocomputing. 2018;282:248–61.
Yousaf S, RaviPrakash H, Anwar SM, Sohail N, Bagci U. State-of-the-art in brain tumor segmentation and current challenges. In: Machine learning in clinical neuroimaging and radiogenomics in neuro-oncology. Springer; 2020. p. 189–98.
Yousaf S, Anwar SM, RaviPrakash H, Bagci U. Brain tumor survival prediction using radiomics features. In: Machine learning in clinical neuroimaging and radiogenomics in neuro-oncology. Springer; 2020. p. 284–93.
Sun L, Zhang S, Chen H, Luo L. Brain tumor segmentation and survival prediction using multimodal MRI scans with deep learning. Front Neurosci. 2019;13:810.
Farooq A, Anwar S, Awais M, Rehman S. A deep CNN based multi-class classification of Alzheimer’s disease using MRI. In: 2017 IEEE international conference on imaging systems and techniques (IST). IEEE; 2017. p. 1–6.
Jo T, Nho K, Saykin AJ. Deep learning in Alzheimer’s disease: diagnostic classification and prognostic prediction using neuroimaging data. Front Aging Neurosci. 2019;11:220.
Anwar SM, et al. Semi-supervised deep learning for multi-tissue segmentation from multi-contrast MRI. J Signal Process Syst. 2020;1–14.
Altaf T, Anwar SM, Gul N, Majeed MN, Majid M. Multi-class Alzheimer’s disease classification using image and clinical features. Biomed Signal Process Control. 2018;43:64–74.
Bahadir CD, Wang AQ, Dalca AV, Sabuncu MR. Deep-learning-based optimization of the under-sampling pattern in MRI. IEEE Trans Comput Imaging. 2020;6:1139–52.
Saeed SMU, Anwar SM, Majid M, Bhatti AM. Psychological stress measurement using low cost single channel EEG headset. In: 2015 IEEE international symposium on signal processing and information technology (ISSPIT). IEEE; 2015. p. 581–5.
RaviPrakash H, et al. Deep learning provides exceptional accuracy to ECoG-based functional language mapping for epilepsy surgery. Front Neurosci. 2020;14:409.
Masoudi S, Anwar SM, Harmon SA, Choyke PL, Turkbey B, Bagci U. Adipose tissue segmentation in unlabeled abdomen MRI using cross modality domain adaptation. In: 2020 42nd annual international conference of the IEEE engineering in medicine & biology society (EMBC). IEEE; 2020. p. 1624–8.
Mustaqeem A, Anwar SM, Majid M. Multiclass classification of cardiac arrhythmia using improved feature selection and SVM invariants. Comput Math Methods Med. 2018;2018. Article ID 7310496.
Mustaqeem A, Anwar SM, Majid M. A modular cluster based collaborative recommender system for cardiac patients. Artif Intell Med. 2020;102:101761.
Bodén AC, Molin J, Garvin S, West RA, Lundström C, Treanor D. The human-in-the-loop: an evaluation of pathologists’ interaction with AI in clinical practice. Histopathology. 2021;79:210.
Goyal D, Medical image segmentation using interactive refinement (Doctoral dissertation, Arizona State University). 2021.
Holzinger A, Malle B, Saranti A, Pfeifer B. Towards multi-modal causability with Graph Neural Networks enabling information fusion for explainable AI. Inf Fusion. 2021;71:28–37.
Pearl J. Causality. Cambridge University Press; 2009.
Garreau D, Luxburg U. Explaining the explainer: a first theoretical analysis of LIME. In: International conference on artificial intelligence and statistics. PMLR; 2020. p. 1287–96.
Zeiler MD, Fergus R. Visualizing and understanding convolutional networks. In: Computer vision – ECCV 2014. Cham: Springer International Publishing; 2014. p. 818–33.
Chen J, Song L, Wainwright M, Jordan M. Learning to explain: an information-theoretic perspective on model interpretation. In: International conference on machine learning. PMLR; 2018. p. 883–92.
Aas K, Jullum M, Løland A. Explaining individual predictions when features are dependent: more accurate approximations to Shapley values. arXiv preprint arXiv:1903.10464, 2019.
Smilkov D, Thorat N, Kim B, Viégas F, Wattenberg M. Smoothgrad: removing noise by adding noise. arXiv preprint arXiv:1706.03825, 2017.
Montavon G, Binder A, Lapuschkin S, Samek W, Müller K-R. Layer-wise relevance propagation: an overview. In: Explainable AI: interpreting, explaining and visualizing deep learning. Springer; 2019. p. 193–209.
Bach S, Binder A, Montavon G, Klauschen F, Müller K-R, Samek W. On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS One. 2015;10(7):e0130140.
Samek W, Montavon G, Lapuschkin S, Anders CJ, Müller K-R. Explaining deep neural networks and beyond: a review of methods and applications. Proc IEEE. 2021;109(3):247–78.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this entry
Cite this entry
Anwar, S.M. (2022). AIM and Explainable Methods in Medical Imaging and Diagnostics. In: Lidströmer, N., Ashrafian, H. (eds) Artificial Intelligence in Medicine. Springer, Cham. https://doi.org/10.1007/978-3-030-64573-1_293
Download citation
DOI: https://doi.org/10.1007/978-3-030-64573-1_293
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-64572-4
Online ISBN: 978-3-030-64573-1
eBook Packages: MedicineReference Module Medicine