Skip to main content

Advertisement

Log in

The unintended consequences of artificial intelligence in paediatric radiology

  • ESPR Belgrade 2023 - Postgraduate Course and Taskforce Lectures
  • Published:
Pediatric Radiology Aims and scope Submit manuscript

Abstract

Over the past decade, there has been a dramatic rise in the interest relating to the application of artificial intelligence (AI) in radiology. Originally only ‘narrow’ AI tasks were possible; however, with increasing availability of data, teamed with ease of access to powerful computer processing capabilities, we are becoming more able to generate complex and nuanced prediction models and elaborate solutions for healthcare. Nevertheless, these AI models are not without their failings, and sometimes the intended use for these solutions may not lead to predictable impacts for patients, society or those working within the healthcare profession. In this article, we provide an overview of the latest opinions regarding AI ethics, bias, limitations, challenges and considerations that we should all contemplate in this exciting and expanding field, with a special attention to how this applies to the unique aspects of a paediatric population. By embracing AI technology and fostering a multidisciplinary approach, it is hoped that we can harness the power AI brings whilst minimising harm and ensuring a beneficial impact on radiology practice.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Shelmerdine SC, Rosendahl K, Arthurs OJ (2022) Artificial intelligence in paediatric radiology: international survey of health care professionals’ opinions. Pediatr Radiol. https://doi.org/10.1007/s00247-021-05195-5

    Article  PubMed  PubMed Central  Google Scholar 

  2. Allen B, Agarwal S, Coombs L et al (2021) 2020 ACR Data Science Institute artificial intelligence survey. J Am Coll Radiol. https://doi.org/10.1016/j.jacr.2021.04.002

    Article  PubMed  Google Scholar 

  3. Tucci V, Saary J, Doyle TE (2021) Factors influencing trust in medical artificial intelligence for healthcare professionals: a narrative review. J Med Artif Intell. https://doi.org/10.21037/jmai-21-25

    Article  Google Scholar 

  4. Allen B Jr, Seltzer SE, Langlotz CP et al (2019) A road map for translational research on artificial intelligence in medical imaging: from the 2018 National Institutes of Health/RSNA/ACR/The Academy Workshop. J Am Coll Radiol. https://doi.org/10.1016/j.jacr.2019.04.014

    Article  PubMed  Google Scholar 

  5. Galsgaard A, Doorschodt T, Holten A-L et al (2022) Artificial intelligence and multidisciplinary team meetings; a communication challenge for radiologists’ sense of agency and position as spider in a web? Eur J Radiol. https://doi.org/10.1016/j.ejrad.2022.110231

    Article  PubMed  Google Scholar 

  6. Liu S, Wang Y, Yang X et al (2019) Deep learning in medical ultrasound analysis: a review. Engineering. https://doi.org/10.1016/j.eng.2018.11.020

    Article  Google Scholar 

  7. Davendralingam N, Sebire NJ, Arthurs OJ, Shelmerdine SC (2021) Artificial intelligence in paediatric radiology: future opportunities. Br J Radiol. https://doi.org/10.1259/bjr.20200975

    Article  PubMed  Google Scholar 

  8. Esteva A, Robicquet A, Ramsundar B, Kuleshov V et al (2019) A guide to deep learning in healthcare. Nat Med. https://doi.org/10.1038/s41591-018-0316-z

    Article  PubMed  Google Scholar 

  9. Roberts M, Driggs D, Thorpe M et al (2021) Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scans. Nature Machine Intelligence. https://doi.org/10.1038/s42256-021-00307-0

    Article  PubMed  PubMed Central  Google Scholar 

  10. Mongan J, Moy L, Kahn CE Jr (2020) Checklist for Artificial Intelligence in Medical Imaging (CLAIM): a guide for authors and reviewers. Radiology Artificial intelligence. https://doi.org/10.1148/ryai.2020200029

    Article  PubMed  PubMed Central  Google Scholar 

  11. Shin HJ, Son NH, Kim MJ, Kim EK (2022) Diagnostic performance of artificial intelligence approved for adults for the interpretation of pediatric chest radiographs. Sci Rep. https://doi.org/10.1038/s41598-022-14519-w

    Article  PubMed  PubMed Central  Google Scholar 

  12. Chouhan V, Singh SK, Khamparia A et al (2020) A novel transfer learning based approach for pneumonia detection in chest X-ray images. Appl Sci. https://doi.org/10.3390/app10020559

    Article  Google Scholar 

  13. Salehi M, Mohammadi R, Ghaffari H et al (2021) Automated detection of pneumonia cases using deep transfer learning with paediatric chest X-ray images. Br J Radiol. https://doi.org/10.1259/bjr.20201263

    Article  PubMed  PubMed Central  Google Scholar 

  14. Zoph B, Vasudevan V, Shlens J, Le QV (2018) Learning transferable architectures for scalable image recognition. arXiv https://doi.org/10.1109/CVPR.2018.00907

  15. Bras G, Fernandes V, Paiva ACd et al (2020) Transfer learning method evaluation for automatic pediatric chest X-ray image segmentation. 2020 International Conference on Systems, Signals and Image Processing (IWSSIP). https://doi.org/10.1109/IWSSIP48289.2020.9145401

  16. Mei X, Lee HC, Diao KY et al (2020) Artificial intelligence-enabled rapid diagnosis of patients with COVID-19. Nat Med. https://doi.org/10.1038/s41591-020-0931-3

    Article  PubMed  PubMed Central  Google Scholar 

  17. Mei X, Liu Z, Robson PM et al (2022) RadImageNet: an open radiologic deep learning research dataset for effective transfer learning. Radiol Artif Intell. https://doi.org/10.1148/ryai.210315

    Article  PubMed  PubMed Central  Google Scholar 

  18. Willemink MJ, Koszek WA, Hardell C et al (2020) Preparing medical imaging data for machine learning. Radiology. https://doi.org/10.1148/radiol.2020192224

    Article  PubMed  PubMed Central  Google Scholar 

  19. Alzubaidi L, Zhang J, Humaidi AJ et al (2021) Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. J Big Data. https://doi.org/10.1186/s40537-021-00444-8

    Article  PubMed  PubMed Central  Google Scholar 

  20. Erickson BJ, Korfiatis P, Akkus Z et al (2017) Toolkits and libraries for deep learning. J Digit Imaging. https://doi.org/10.1007/s10278-017-9965-6

    Article  PubMed  PubMed Central  Google Scholar 

  21. Erickson BJ, Korfiatis P, Kline TL et al (2018) Deep learning in radiology: does one size fit all? J Am Coll Radiol. https://doi.org/10.1016/j.jacr.2017.12.027

    Article  PubMed  PubMed Central  Google Scholar 

  22. Otjen JP, Moore MM, Romberg EK et al (2022) The current and future roles of artificial intelligence in pediatric radiology. Pediatr Radiol. https://doi.org/10.1007/s00247-021-05086-9

    Article  PubMed  Google Scholar 

  23. Marr B (2022) The problem with biased AIs (and how to make AI better). https://www.forbes.com/sites/bernardmarr/2022/09/30/the-problem-with-biased-ais-and-how-to-make-ai-better/?sh=24a2ee154770 Accessed 16 June 2023

  24. Wu Q, Ma H, Sun J et al (2022) Application of deep-learning-based artificial intelligence in acetabular index measurement. Front Pediatr. https://doi.org/10.3389/fped.2022.1049575

    Article  PubMed  PubMed Central  Google Scholar 

  25. Padash S, Mohebbian MR, Adams SJ et al (2022) Pediatric chest radiograph interpretation: how far has artificial intelligence come? A systematic literature review. Pediatr Radiol. https://doi.org/10.1007/s00247-022-05368-w

    Article  PubMed  PubMed Central  Google Scholar 

  26. Monah SR, Wagner MW, Biswas A et al (2022) Data governance functions to support responsible data stewardship in pediatric radiology research studies using artificial intelligence. Pediatr Radiol. https://doi.org/10.1007/s00247-022-05427-2

    Article  PubMed  Google Scholar 

  27. Ott MA (2022) Bias in, bias out: ethical considerations for the application of machine learning in pediatrics. J Pediatr. https://doi.org/10.1016/j.jpeds.2022.01.035

    Article  PubMed  Google Scholar 

  28. Yu AC, Mohajer B, Eng J (2022) External validation of deep learning algorithms for radiologic diagnosis: a systematic review. Radiol Artif Intell. https://doi.org/10.1148/ryai.210064

    Article  PubMed  PubMed Central  Google Scholar 

  29. Feng J, Phillips RV, Malenica I et al (2022) Clinical artificial intelligence quality improvement: towards continual monitoring and updating of AI algorithms in healthcare. NPJ digital medicine. https://doi.org/10.1038/s41746-022-00611-y

    Article  PubMed  PubMed Central  Google Scholar 

  30. Excellence NIfHaC (2022) Evidence standards framework for digital health technologies, https://www.nice.org.uk/corporate/ecd7. Accessed 16 June 2023

  31. Chetlen AL, Petscavage-Thomas J, Cherian RA et al (2020) Collaborative learning in radiology: from peer review to peer learning and peer coaching. Acad Radiol. https://doi.org/10.1016/j.acra.2019.09.021

    Article  PubMed  Google Scholar 

  32. Lundstrom C, Lindvall M (2023) Mapping the landscape of care providers’ quality assurance approaches for AI in diagnostic imaging. J Digit Imaging. https://doi.org/10.1007/s10278-022-00731-7

    Article  PubMed  Google Scholar 

  33. Daye D, Wiggins WF, Lungren MP et al (2022) Implementation of clinical artificial intelligence in radiology: who decides and how? Radiology. https://doi.org/10.1148/radiol.212151

    Article  PubMed  Google Scholar 

  34. (2023) Pause giant AI experiments: an open letter. https://futureoflife.org/open-letter/pause-giant-ai-experiments/. Accessed 16 June 2023

  35. Royal College of Radiologists R (2023) RCR Clinical Radiology Workforce Census 2022. https://www.rcr.ac.uk/clinical-radiology/rcr-clinical-radiology-workforce-census-2022 Accessed 16 June 2023

  36. Wagner MW, Ertl-Wagner BB (2023) Accuracy of information and references using ChatGPT-3 for retrieval of clinical radiological information. Can Assoc Radiol J = J l’Assoc Canadienne des Radiologistes. https://doi.org/10.1177/08465371231171125

    Article  Google Scholar 

  37. Gaube S, Suresh H, Raue M et al (2021) Do as AI say: susceptibility in deployment of clinical decision-aids. NPJ Digital Med. https://doi.org/10.1038/s41746-021-00385-9

    Article  Google Scholar 

  38. Da Silva M, Flood CM, Goldenberg A, Singh D (2022) Regulating the safety of health-related artificial intelligence. Healthcare policy = Politiques de sante. https://doi.org/10.12927/hcpol.2022.26824

    Article  PubMed  PubMed Central  Google Scholar 

  39. Cath C (2018) Governing artificial intelligence: ethical, legal and technical opportunities and challenges. Philos Transact A Math Phys Eng Sci. https://doi.org/10.1098/rsta.2018.0080

    Article  Google Scholar 

  40. Harvey HB, Gowda V (2021) Regulatory issues and challenges to artificial intelligence adoption. Radiol Clin North Am. https://doi.org/10.1016/j.rcl.2021.07.007

    Article  PubMed  Google Scholar 

  41. Balthazar P, Harri P, Prater A, Safdar NM (2018) Protecting your patients’ interests in the era of big data, artificial intelligence, and predictive analytics. J Am Coll Radiol. https://doi.org/10.1016/j.jacr.2017.11.035

    Article  PubMed  Google Scholar 

  42. Banja JD, Hollstein RD, Bruno MA (2022) When artificial intelligence models surpass physician performance: medical malpractice liability in an era of advanced artificial intelligence. J Am Coll Radiol. https://doi.org/10.1016/j.jacr.2021.11.014

    Article  PubMed  Google Scholar 

  43. Ghuwalewala S, Kulkarni V, Pant R, Kharat A (2022) Levels of autonomous radiology. Interact J Med Res. https://doi.org/10.2196/38655

    Article  PubMed  PubMed Central  Google Scholar 

  44. Pesapane F, Volonte C, Codari M, Sardanelli F (2018) Artificial intelligence as a medical device in radiology: ethical and regulatory issues in Europe and the United States. Insights Imaging. https://doi.org/10.1007/s13244-018-0645-y

    Article  PubMed  PubMed Central  Google Scholar 

  45. Kim B, Koopmanschap I, Mehrizi MHR et al (2021) How does the radiology community discuss the benefits and limitations of artificial intelligence for their work? A systematic discourse analysis. Eur J Radiol. https://doi.org/10.1016/j.ejrad.2021.109566

    Article  PubMed  PubMed Central  Google Scholar 

  46. Larson DB, Magnus DC, Lungren MP, Shah NH, Langlotz CP (2020) Ethics of using and sharing clinical imaging data for artificial intelligence: a proposed framework. Radiology. https://doi.org/10.1148/radiol.2020192536

    Article  PubMed  Google Scholar 

  47. Goisauf M, Cano Abadia M (2022) Ethics of AI in radiology: a review of ethical and societal implications. Front Big Data. https://doi.org/10.3389/fdata.2022.850383

    Article  PubMed  PubMed Central  Google Scholar 

  48. Brady AP, Neri E (2020) Artificial intelligence in radiology-ethical considerations. Diagnostics (Basel, Switzerland). https://doi.org/10.3390/diagnostics10040231

    Article  PubMed  Google Scholar 

  49. Mazurowski MA (2020) Artificial intelligence in radiology: some ethical considerations for radiologists and algorithm developers. Acad Radiol. https://doi.org/10.1016/j.acra.2019.04.024

    Article  PubMed  Google Scholar 

  50. AkinciD’Antonoli T (2020) Ethical considerations for artificial intelligence: an overview of the current radiology landscape. Diagn Interv Radiol (Ankara, Turkey). https://doi.org/10.5152/dir.2020.19279

    Article  Google Scholar 

  51. Mudgal KS, Das N (2020) The ethical adoption of artificial intelligence in radiology. BJR Open. https://doi.org/10.1259/bjro.20190020

    Article  PubMed  Google Scholar 

  52. Geis JR, Brady A, Wu CC et al (2019) Ethics of artificial intelligence in radiology: summary of the joint European and North American multisociety statement. Insights Into Imaging. https://doi.org/10.1186/s13244-019-0785-8

    Article  PubMed  PubMed Central  Google Scholar 

  53. Commission E (2019) Ethics guidelines for trustworthy AI. https://digital-strategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-ai Accessed 16 June 2023

  54. Kenny LM, Nevin M, Fitzpatrick K (2021) Ethics and standards in the use of artificial intelligence in medicine on behalf of the Royal Australian and New Zealand College of Radiologists. J Med Imaging Radiat Oncol. https://doi.org/10.1111/1754-9485.13289

    Article  PubMed  PubMed Central  Google Scholar 

  55. Jaremko JL, Azar M, Bromwich R et al (2019) Canadian Association of Radiologists white paper on ethical and legal issues related to artificial intelligence in radiology. Can Assoc Radiol J = J l’Assoc Canadienne des radiologistes. https://doi.org/10.1016/j.carj.2019.03.001

    Article  Google Scholar 

  56. Kelly BS, Judge C, Bollard SM et al (2022) Radiology artificial intelligence: a systematic review and evaluation of methods (RAISE). Eur Radiol. https://doi.org/10.1007/s00330-022-08784-6

    Article  PubMed  PubMed Central  Google Scholar 

  57. Chaddad A, Peng J, Xu J, Bouridane A (2023) Survey of explainable AI techniques in healthcare. Sensors (Basel, Switzerland). https://doi.org/10.3390/s23020634

    Article  PubMed  Google Scholar 

  58. Groen AM, Kraan R, Amirkhan SF et al (2022) A systematic review on the use of explainability in deep learning systems for computer aided diagnosis in radiology: limited use of explainable AI? Eur J Radiol. https://doi.org/10.1016/j.ejrad.2022.110592

    Article  PubMed  Google Scholar 

  59. Ursin F, Timmermann C, Steger F (2022) Explicability of artificial intelligence in radiology: is a fifth bioethical principle conceptually necessary? Bioethics. https://doi.org/10.1111/bioe.12918

    Article  PubMed  Google Scholar 

  60. Neri E, Aghakhanyan G, Zerunian M et al (2023) Explainable AI in radiology: a white paper of the Italian Society of Medical and Interventional Radiology. Radiol Med. https://doi.org/10.1007/s11547-023-01634-5

    Article  PubMed  PubMed Central  Google Scholar 

  61. Zhang J, Zhang ZM (2023) Ethics and governance of trustworthy medical artificial intelligence. BMC Med Inform Decis Mak. https://doi.org/10.1186/s12911-023-02103-9

    Article  PubMed  PubMed Central  Google Scholar 

  62. Ho CWL, Soon D, Caals K, Kapur J (2019) Governance of automated image analysis and artificial intelligence analytics in healthcare. Clin Radiol. https://doi.org/10.1016/j.crad.2019.02.005

    Article  PubMed  Google Scholar 

  63. Miller DD, Brown EW (2019) How cognitive machines can augment medical imaging. AJR Am J Roentgenol. https://doi.org/10.2214/AJR.18.19914

    Article  PubMed  Google Scholar 

  64. Mazurowski MA (2021) Do we expect more from radiology AI than from radiologists? Radiol Artif Intell. https://doi.org/10.1148/ryai.2021200221

    Article  PubMed  PubMed Central  Google Scholar 

  65. Coiera E (2019) The price of artificial intelligence. Yearb Med Inform. https://doi.org/10.1055/s-0039-1677892

    Article  PubMed  PubMed Central  Google Scholar 

  66. Abramoff MD, Roehrenbeck C, Trujillo S et al (2022) A reimbursement framework for artificial intelligence in healthcare. NPJ Digit Medi. https://doi.org/10.1038/s41746-022-00621-w

    Article  Google Scholar 

  67. Schoppe K (2018) Artificial intelligence: who pays and how? J Am Coll Radiol. https://doi.org/10.1016/j.jacr.2018.05.036

    Article  PubMed  Google Scholar 

  68. Chen MM, Golding LP, Nicola GN (2021) Who will pay for AI? Radiol Artif Intell. https://doi.org/10.1148/ryai.2021210030

    Article  PubMed  PubMed Central  Google Scholar 

  69. Golding LP, Nicola GN (2019) A business case for artificial intelligence tools: the currency of improved quality and reduced cost. J Am Coll Radiol. https://doi.org/10.1016/j.jacr.2019.05.004

    Article  PubMed  Google Scholar 

  70. Sidebottom R, Lyburn I, Brady M, Vinnicombe S (2021) Fair shares: building and benefiting from healthcare AI with mutually beneficial structures and development partnerships. Br J Cancer. https://doi.org/10.1038/s41416-021-01454-2

    Article  PubMed  PubMed Central  Google Scholar 

  71. Neri E, Coppola F, Miele V et al (2020) Artificial intelligence: who is responsible for the diagnosis? Radiol Med. https://doi.org/10.1007/s11547-020-01135-9

    Article  PubMed  PubMed Central  Google Scholar 

  72. Naik N, Hameed BMZ, Shetty DK et al (2022) Legal and ethical consideration in artificial intelligence in healthcare: who takes responsibility? Front Surg. https://doi.org/10.3389/fsurg.2022.862322

    Article  PubMed  PubMed Central  Google Scholar 

  73. Price WN 2nd, Gerke S, Cohen IG (2021) How much can potential jurors tell us about liability for medical artificial intelligence? J Nucl Med : Off Publ, Soc Nucl Med. https://doi.org/10.2967/jnumed.120.257196

    Article  Google Scholar 

  74. Da Silva M, Horsley T, Singh D et al (2022) Legal concerns in health-related artificial intelligence: a scoping review protocol. Syst Rev. https://doi.org/10.1186/s13643-022-01939-y

    Article  PubMed  PubMed Central  Google Scholar 

  75. van Assen M, Lee SJ, De Cecco CN (2020) Artificial intelligence from A to Z: from neural network to legal framework. Eur J Radiol. https://doi.org/10.1016/j.ejrad.2020.109083

    Article  PubMed  Google Scholar 

  76. Giansanti D (2022) The regulation of artificial intelligence in digital radiology in the scientific literature: a narrative review of reviews. Healthcare (Basel, Switzerland). https://doi.org/10.3390/healthcare10101824

    Article  PubMed  PubMed Central  Google Scholar 

  77. Tobia K, Nielsen A, Stremitzer A (2021) When does physician use of ai increase liability? J Nucl Med : Off Publ, Soc Nucl Med. https://doi.org/10.2967/jnumed.120.256032

    Article  Google Scholar 

  78. Fasterholdt I, Kjolhede T, Naghavi-Behzad M et al (2022) Model for ASsessing the value of Artificial Intelligence in medical imaging (MAS-AI). Int J Technol Assess Health Care. https://doi.org/10.1017/S0266462322000551

    Article  PubMed  Google Scholar 

  79. Tadavarthi Y, Makeeva V, Wagstaff W et al (2022) Overview of noninterpretive artificial intelligence models for safety, quality, workflow, and education applications in radiology practice. Radiol Artif Intell. https://doi.org/10.1148/ryai.210114

    Article  PubMed  PubMed Central  Google Scholar 

  80. van Leeuwen KG, de Rooij M, Schalekamp S et al (2022) How does artificial intelligence in radiology improve efficiency and health outcomes? Pediatr Radiol. https://doi.org/10.1007/s00247-021-05114-8

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Contributions

S. C. S. conceived, supervised and supported the study. All authors performed literature review and drafted the initial manuscript for their allocated subsection. All authors reviewed and approved the final manuscript.

Corresponding author

Correspondence to Susan C. Shelmerdine.

Ethics declarations

Ethics approval

Ethical approval was not applicable to this review article.

Conflicts of interest

P. C. has received speaker fees from Chiesi and Vertex Pharmaceutical. P. C. is funded by the Dutch Research Council (NWO-Veni) and Horizon EIC Pathfinder.

J. N. is an Industry Employee of Envisionit Deep (UK), a company that uses AI as a clinical decision support tool in medical imaging diagnosis. J.N. is also the director of Paeds Diagnostic Imaging and J Naidoo Inc. J. N. did not receive financial or research support from the companies for this article and the views expressed are those of the author and not of Envisionit Deep AI, Paeds Diagnostic Imaging or J Naidoo Inc.

S. C. S. is funded by an NIHR Advanced Fellowship Award (NIHR-301322). This article presents independent research funded by the National Institute for Health and Care Research (NIHR) and supported by the Great Ormond Street Hospital Biomedical Research Centre. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health. E.P. is funded by the Royal Marsden Cancer Charity.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ciet, P., Eade, C., Ho, ML. et al. The unintended consequences of artificial intelligence in paediatric radiology. Pediatr Radiol 54, 585–593 (2024). https://doi.org/10.1007/s00247-023-05746-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00247-023-05746-y

Keywords

Navigation