Skip to main content

AIM and Explainable Methods in Medical Imaging and Diagnostics

  • Reference work entry
  • First Online:
Artificial Intelligence in Medicine
  • 416 Accesses

Abstract

Medical imaging and diagnostics have benefited from recent advances in machine learning in general and deep learning in particular. There are a large number of studies that report significant performance in a variety of medical image analysis tasks. At the same time, advances in time series analysis of electronic health records and physiological signals from a variety of sources (including clinical and nonclinical wearable sensors) have enabled efficient clinical pipelines and diagnostic performance. While there are a large number of studies that report such advances and use cases, there is a certain level of resistance to clinical adaptability of such methods. We attribute one of the major reasons for this to be the black-box nature of such machine learning and data-driven models. While clinical decision-making, for example, using radiology, relies not only on radiographic information but also on clinical expertise (that could rely on clinical history of a patient as well as demographic information), such informed decision makes the backbone of clinical practice. Hence, machine learning should adapt to making such informed decisions for wider adaptability and finding more practical use cases. We argue that explainable methods, where a machine learning-based model provides supporting information for their decisions making them understandable, will be more representative of what is required in clinical practice. In turn, such methods would augment the current medical imaging and diagnosis pipeline and hence allow adaptation of artificial intelligence in clinical workflows. This would transform the healthcare industry with far-reaching benefits for both clinical practitioners and patients enabling precise and personalized medicine.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 699.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 1,199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Feng Z, et al. Early prediction of disease progression in COVID-19 pneumonia patients with chest CT and clinical characteristics. Nat Commun. 2020;11(1):1–9.

    Article  Google Scholar 

  2. Li X, et al. Multi-resolution convolutional networks for chest X-ray radiograph based lung nodule detection. Artif Intell Med. 2020;103:101744.

    Article  Google Scholar 

  3. Rodriguez-Ruiz A, et al. Stand-alone artificial intelligence for breast cancer detection in mammography: comparison with 101 radiologists. JNCI: J Natl Cancer Inst. 2019;111(9):916–22.

    Article  Google Scholar 

  4. Obermeyer Z, Emanuel EJ. Predicting the future – big data, machine learning, and clinical medicine. N Engl J Med. 2016;375(13):1216.

    Article  Google Scholar 

  5. Menze BH, et al. The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging. 2014;34(10):1993–2024.

    Article  Google Scholar 

  6. Zbontar J, et al. fastMRI: an open dataset and benchmarks for accelerated MRI. arXiv preprint arXiv:1811.08839, 2018.

    Google Scholar 

  7. Anwar SM, Majid M, Qayyum A, Awais M, Alnowami M, Khan MK. Medical image analysis using convolutional neural networks: a review. J Med Syst. 2018;42(11):1–13.

    Article  Google Scholar 

  8. Qayyum A, Anwar SM, Awais M, Majid M. Medical image retrieval using deep convolutional neural network. Neurocomputing. 2017;266:8–20.

    Article  Google Scholar 

  9. Hussain S, Anwar SM, Majid M. Segmentation of glioma tumors in brain using deep convolutional neural network. Neurocomputing. 2018;282:248–61.

    Article  Google Scholar 

  10. Yousaf S, RaviPrakash H, Anwar SM, Sohail N, Bagci U. State-of-the-art in brain tumor segmentation and current challenges. In: Machine learning in clinical neuroimaging and radiogenomics in neuro-oncology. Springer; 2020. p. 189–98.

    Chapter  Google Scholar 

  11. Yousaf S, Anwar SM, RaviPrakash H, Bagci U. Brain tumor survival prediction using radiomics features. In: Machine learning in clinical neuroimaging and radiogenomics in neuro-oncology. Springer; 2020. p. 284–93.

    Chapter  Google Scholar 

  12. Sun L, Zhang S, Chen H, Luo L. Brain tumor segmentation and survival prediction using multimodal MRI scans with deep learning. Front Neurosci. 2019;13:810.

    Article  Google Scholar 

  13. Farooq A, Anwar S, Awais M, Rehman S. A deep CNN based multi-class classification of Alzheimer’s disease using MRI. In: 2017 IEEE international conference on imaging systems and techniques (IST). IEEE; 2017. p. 1–6.

    Google Scholar 

  14. Jo T, Nho K, Saykin AJ. Deep learning in Alzheimer’s disease: diagnostic classification and prognostic prediction using neuroimaging data. Front Aging Neurosci. 2019;11:220.

    Article  Google Scholar 

  15. Anwar SM, et al. Semi-supervised deep learning for multi-tissue segmentation from multi-contrast MRI. J Signal Process Syst. 2020;1–14.

    Google Scholar 

  16. Altaf T, Anwar SM, Gul N, Majeed MN, Majid M. Multi-class Alzheimer’s disease classification using image and clinical features. Biomed Signal Process Control. 2018;43:64–74.

    Article  Google Scholar 

  17. Bahadir CD, Wang AQ, Dalca AV, Sabuncu MR. Deep-learning-based optimization of the under-sampling pattern in MRI. IEEE Trans Comput Imaging. 2020;6:1139–52.

    Article  Google Scholar 

  18. Saeed SMU, Anwar SM, Majid M, Bhatti AM. Psychological stress measurement using low cost single channel EEG headset. In: 2015 IEEE international symposium on signal processing and information technology (ISSPIT). IEEE; 2015. p. 581–5.

    Chapter  Google Scholar 

  19. RaviPrakash H, et al. Deep learning provides exceptional accuracy to ECoG-based functional language mapping for epilepsy surgery. Front Neurosci. 2020;14:409.

    Article  Google Scholar 

  20. Masoudi S, Anwar SM, Harmon SA, Choyke PL, Turkbey B, Bagci U. Adipose tissue segmentation in unlabeled abdomen MRI using cross modality domain adaptation. In: 2020 42nd annual international conference of the IEEE engineering in medicine & biology society (EMBC). IEEE; 2020. p. 1624–8.

    Chapter  Google Scholar 

  21. Mustaqeem A, Anwar SM, Majid M. Multiclass classification of cardiac arrhythmia using improved feature selection and SVM invariants. Comput Math Methods Med. 2018;2018. Article ID 7310496.

    Google Scholar 

  22. Mustaqeem A, Anwar SM, Majid M. A modular cluster based collaborative recommender system for cardiac patients. Artif Intell Med. 2020;102:101761.

    Article  Google Scholar 

  23. Bodén AC, Molin J, Garvin S, West RA, Lundström C, Treanor D. The human-in-the-loop: an evaluation of pathologists’ interaction with AI in clinical practice. Histopathology. 2021;79:210.

    Article  Google Scholar 

  24. Goyal D, Medical image segmentation using interactive refinement (Doctoral dissertation, Arizona State University). 2021.

    Google Scholar 

  25. Holzinger A, Malle B, Saranti A, Pfeifer B. Towards multi-modal causability with Graph Neural Networks enabling information fusion for explainable AI. Inf Fusion. 2021;71:28–37.

    Article  Google Scholar 

  26. Pearl J. Causality. Cambridge University Press; 2009.

    Book  Google Scholar 

  27. Garreau D, Luxburg U. Explaining the explainer: a first theoretical analysis of LIME. In: International conference on artificial intelligence and statistics. PMLR; 2020. p. 1287–96.

    Google Scholar 

  28. Zeiler MD, Fergus R. Visualizing and understanding convolutional networks. In: Computer vision – ECCV 2014. Cham: Springer International Publishing; 2014. p. 818–33.

    Chapter  Google Scholar 

  29. Chen J, Song L, Wainwright M, Jordan M. Learning to explain: an information-theoretic perspective on model interpretation. In: International conference on machine learning. PMLR; 2018. p. 883–92.

    Google Scholar 

  30. Aas K, Jullum M, Løland A. Explaining individual predictions when features are dependent: more accurate approximations to Shapley values. arXiv preprint arXiv:1903.10464, 2019.

    Google Scholar 

  31. Smilkov D, Thorat N, Kim B, Viégas F, Wattenberg M. Smoothgrad: removing noise by adding noise. arXiv preprint arXiv:1706.03825, 2017.

    Google Scholar 

  32. Montavon G, Binder A, Lapuschkin S, Samek W, Müller K-R. Layer-wise relevance propagation: an overview. In: Explainable AI: interpreting, explaining and visualizing deep learning. Springer; 2019. p. 193–209.

    Chapter  Google Scholar 

  33. Bach S, Binder A, Montavon G, Klauschen F, Müller K-R, Samek W. On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS One. 2015;10(7):e0130140.

    Article  Google Scholar 

  34. Samek W, Montavon G, Lapuschkin S, Anders CJ, Müller K-R. Explaining deep neural networks and beyond: a review of methods and applications. Proc IEEE. 2021;109(3):247–78.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Anwar, S.M. (2022). AIM and Explainable Methods in Medical Imaging and Diagnostics. In: Lidströmer, N., Ashrafian, H. (eds) Artificial Intelligence in Medicine. Springer, Cham. https://doi.org/10.1007/978-3-030-64573-1_293

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-64573-1_293

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-64572-4

  • Online ISBN: 978-3-030-64573-1

  • eBook Packages: MedicineReference Module Medicine

Publish with us

Policies and ethics