Although examples of algorithms designed to improve healthcare delivery abound, for many, clinical integration will not be achieved. The deployment cost of machine learning models is an underappreciated barrier to success. Experts propose three criteria that, assessed early, could help estimate the deployment cost.
Change history
14 April 2020
A Correction to this paper has been published: https://doi.org/10.1038/s41591-020-0862-z
References
Yu, K.-H., Beam, A. L. & Kohane, I. S. Nat. Biomed. Eng. 2, 719–731 (2018).
Topol, E. J. Nat. Med. 25, 44–56 (2019).
Esteva, A. et al. Nat. Med. 25, 25–29 (2019).
Amarasingham, R., Patzer, R. E., Huesch, M., Nguyen, N. Q. & Xie, B. Health Aff. 33, 1148–1154 (2014).
Wiens, J. et al. Nat. Med. https://doi.org/10.1038/s41591-019-0548-6 (2019).
Shah, N. H., Milstein, A. & Bagley, S. C. JAMA https://doi.org/10.1001/jama.2019.10306 (2019).
Cresswell, K. & Sheikh, A. Int. J. Med. Inform. 82, e73–e86 (2013).
Larson, D. B. et al. Radiology 287, 313–322 (2018).
Halabi, S. S. Validation of an artificial intelligence-based algorithm for skeletal age assessment. ClinicalTrials.gov https://clinicaltrials.gov/ct2/show/NCT03530098 (last updated October 2019).
Escobar, G. J. et al. J. Hosp. Med. 11 (Suppl. 1), S18–S24 (2016).
Dummett, B. A. et al. J. Hosp. Med. 11 (Suppl. 1), S25–S31 (2016).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Rights and permissions
About this article
Cite this article
Morse, K.E., Bagley, S.C. & Shah, N.H. Estimate the hidden deployment cost of predictive models to improve patient care. Nat Med 26, 18–19 (2020). https://doi.org/10.1038/s41591-019-0651-8
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41591-019-0651-8
- Springer Nature America, Inc.
This article is cited by
-
Implementation of machine learning in the clinic: challenges and lessons in prospective deployment from the System for High Intensity EvaLuation During Radiation Therapy (SHIELD-RT) randomized controlled study
BMC Bioinformatics (2022)
-
Artificial intelligence-enabled decision support in nephrology
Nature Reviews Nephrology (2022)
-
Deploying digital health tools within large, complex health systems: key considerations for adoption and implementation
npj Digital Medicine (2022)
-
Evaluation of domain generalization and adaptation on improving model robustness to temporal dataset shift in clinical medicine
Scientific Reports (2022)
-
How can we discover the most valuable types of big data and artificial intelligence-based solutions? A methodology for the efficient development of the underlying analytics that improve care
BMC Medical Informatics and Decision Making (2021)