Chatbots powered by artificial intelligence used in patient care are regulated as medical devices, but their unreliability precludes approval as such.
References
Singhal, K. et al. Preprint at https://doi.org/10.48550/arXiv.2212.13138 (2022).
Roose, K. New York Times https://go.nature.com/3X7xXku (5 December 2022).
Lee, P. et al. N. Engl. J. Med. 388, 1233–1239 (2023).
Korngiebel, D. M. et al. NPJ Digit. Med. 4, 93 (2021).
Wolfram, S. Stephen Wolfram Writings https://go.nature.com/3qP9hBi (14 February 2023).
Stokel-Walker, C. et al. Nature 614, 214–216 (2023).
Riel, N. V. et al. BJGP Open 1, bjgpopen17X100833 (2017).
Dorfman, S. PM360 https://go.nature.com/3Jfzbo0 (2019).
European Union. Regulation (EU) 2017/745 of the European Parliament and of the Council (5 April 2017).
US FDA. https://go.nature.com/3NwlVOc (2022).
Stokel-Walker, C. Nature https://doi.org/10.1038/d41586-023-00423-4 (2023).
Dawes, R. AINews https://go.nature.com/3p9HRoY (28 October 2020).
Ingram, D. NBC News https://go.nature.com/43ZEGip (14 January 2023).
Yang, X. et al. NPJ Digit. Med. 5, 194 (2022).
Acknowledgements
This work was supported by the German Federal Ministry of Education and Research (Bundesministerium für Bildung und Forschung, BMBF) through the European Union-financed NextGenerationEU program under grant number 16KISA100K, project PATH (Personal Mastery of Health and Wellness Data).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
S.G. has or has had consulting relationships with Una Health GmbH, Lindus Health Ltd, Flo Health Ltd, Thymia Ltd and Ada Health GmbH; and holds share options in Ada Health GmbH. E.V. is a partner of Axon Lawyers. H.H. is owner and managing director of Hardian Ltd. T.M. is an unpaid advisory board member of Pumpinheart Ltd; was previously a senior medical officer in medical devices at the Health Products Regulatory Authority, Ireland; and was previously co-chair of the Clinical Investigation and Evaluation Working Group of the European Commission. P.W. is employed by Wicks Digital Health Ltd, which has received funding from Ada Health, AstraZeneca, Biogen, Bold Health, Camoni, Compass Pathways, Corevitas, EIT, Endava, Happify, HealthUnlocked, Inbeeo, Kheiron Medical, Lindus Health, MedRhythms, PatientsLikeMe, Sano Genetics, Self Care Catalysts, The Learning Corp, The Wellcome Trust, THREAD Research, United Genomics, VeraSci and Woebot. P.W. and spouse are shareholders of WDH Investments Ltd, which owns stock in BlueSkeye AI Ltd, Earswitch Ltd, Sano Genetics Ltd and Una Health GmbH.
Rights and permissions
About this article
Cite this article
Gilbert, S., Harvey, H., Melvin, T. et al. Large language model AI chatbots require approval as medical devices. Nat Med 29, 2396–2398 (2023). https://doi.org/10.1038/s41591-023-02412-6
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41591-023-02412-6
- Springer Nature America, Inc.
This article is cited by
-
Digital clinical empathy in a live chat: multiple findings from a formative qualitative study and usability tests
BMC Health Services Research (2024)
-
Guardrails for the use of generalist AI in cancer care
Nature Reviews Cancer (2024)
-
Augmented non-hallucinating large language models as medical information curators
npj Digital Medicine (2024)
-
A guide to artificial intelligence for cancer researchers
Nature Reviews Cancer (2024)
-
Artificial intelligence in liver cancer — new tools for research and patient management
Nature Reviews Gastroenterology & Hepatology (2024)