Skip to main content

Advertisement

SpringerLink
Log in

Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist

  • Comment
  • Published:

From Nature Medicine

View current issue Submit your manuscript

Here we present the MI-CLAIM checklist, a tool intended to improve transparent reporting of AI algorithms in medicine.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Code availability

A public Github repository (https://github.com/beaunorgeot/MI-CLAIM) has been set up to coincide with the release of this manuscript, which will allow the community to comment on existing sections and suggest additions.

References

  1. Schwartz, W. B. N. Engl. J. Med. 283, 1257–1264 (1970).

    Article  CAS  PubMed  Google Scholar 

  2. Shortliffe, E. H., Axline, S. G., Buchanan, B. G., Merigan, T. C. & Cohen, S. N. Comput. Biomed. Res. 6, 544–560 (1973).

    Article  CAS  PubMed  Google Scholar 

  3. Shortliffe, E. H. et al. Comput. Biomed. Res. 8, 303–320 (1975).

    Article  CAS  PubMed  Google Scholar 

  4. Ching, T. et al. J. R. Soc. Interface 15, (2018).

  5. Esteva, A. et al. Nat. Med. 25, 24–29 (2019).

    Article  CAS  PubMed  Google Scholar 

  6. Zou, J. et al. Nat. Genet. 51, 12–18 (2019).

    Article  CAS  PubMed  Google Scholar 

  7. Henry, K. E., Hager, D. N., Pronovost, P. J. & Saria, S. Sci. Transl. Med. 7, 299ra122 (2015).

    Article  PubMed  Google Scholar 

  8. Gulshan, V. et al. J. Am. Med. Assoc. 316, 2402–2410 (2016).

    Article  Google Scholar 

  9. Norgeot, B. et al. JAMA Netw. Open 2, e190606 (2019).

    Article  PubMed  PubMed Central  Google Scholar 

  10. Rajkomar, A. et al. NPJ Digit Med. 1, 18 (2018).

    Article  PubMed  PubMed Central  Google Scholar 

  11. Lipton, Z. C. Queue 16, 31–57 (2018).

    Article  Google Scholar 

  12. Topol, E.J. Deep Medicine: How Artificial Intelligence Can Make Healthcare Human Again 1st edn. (Basic Books, 2019).

  13. Rivera, S. C. et al. Nat. Med. https://doi.org/10.1038/s41591-020-1037-7 (2020).

  14. Liu, X. et al. Nat. Med. https://doi.org/10.1038/s41591-020-1034-x (2020).

  15. Moher, D. et al. Br. Med. J. 340, c869 (2010).

    Article  Google Scholar 

  16. von Elm, E. et al. Ann. Intern. Med. 147, 573–577 (2007).

    Article  Google Scholar 

  17. Schwarz, C. G. et al. N. Engl. J. Med. 381, 1684–1686 (2019).

    Article  PubMed  PubMed Central  Google Scholar 

  18. Obermeyer, Z., Powers, B., Vogeli, C. & Mullainathan, S. Science 366, 447–453 (2019).

    Article  CAS  PubMed  Google Scholar 

  19. Subbaswamy, A. & Saria, S. Biostatistics 21, 345–352 (2020).

    PubMed  Google Scholar 

  20. Poplin, R. et al. Nat Biomed Eng. 2, 158–164 (2018).

    Article  PubMed  Google Scholar 

  21. Pan, J., McGuinness, K., Sayrol, E., O’Connor, N. & Giro-i-Nieto, X. arXiv https://ui.adsabs.harvard.edu/abs/2016arXiv160300845P (2016).

  22. Lundberg, S. & Lee, S.-I. arXiv https://ui.adsabs.harvard.edu/abs/2017arXiv170507874L (2017).

Download references

Author information

Authors and Affiliations

  1. Bakar Computational Health Sciences Institute, University of California, San Francisco, San Francisco, CA, USA

    Beau Norgeot, Rima Arnaout & Atul J. Butte

  2. Scripps Research Translational Institute, San Diego, CA, USA

    Giorgio Quer, Ali Torkamani, Raquel Dias & Eric Topol

  3. Department of Biomedical Informatics, Boston, MA, USA

    Brett K. Beaulieu-Jones & Isaac S. Kohane

  4. Division of Rheumatology, Department of Medicine, University of California, San Francisco, San Francisco, CA, USA

    Milena Gianfrancesco

  5. Department of Computer Science, Johns Hopkins University, Baltimore, MD, USA

    Suchi Saria

  6. Bayesian Health, New York, NY, USA

    Suchi Saria

  7. Division of Health Policy and Management, School of Public Health, University of California at Berkeley, Berkeley, CA, USA

    Ziad Obermeyer

  8. Department of Statistics and Department of Electrical Engineering & Computer Science, University of California at Berkeley, Berkeley, CA, USA

    Bin Yu

Authors
  1. Beau Norgeot
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Giorgio Quer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Brett K. Beaulieu-Jones
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ali Torkamani
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Raquel Dias
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Milena Gianfrancesco
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Rima Arnaout
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Isaac S. Kohane
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Suchi Saria
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Eric Topol
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Ziad Obermeyer
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Bin Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Atul J. Butte
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Atul J. Butte.

Ethics declarations

Competing interests

I.S.K. is on the scientific advisory boards of Pulse Data and Medaware, both companies involved in predictive analytics. S.S. is a founder of, and holds equity in, Bayesian Health. The results of the study discussed in this publication could affect the value of Bayesian Health. This arrangement has been reviewed and approved by Johns Hopkins University in accordance with its conflict-of-interest policies. S.S. is a member of the scientific advisory board for PatientPing. B.K.B.-J. is a cofounder of Salutary, Inc. B.N. is employed by Anthem. A.J.B. is a cofounder of and consultant to Personalis and NuMedii; consultant to Samsung, Mango Tree Corporation and, in the recent past, 10x Genomics, Helix, Pathway Genomics and Verinata (Illumina); has served on paid advisory panels or boards for Geisinger Health, Regenstrief Institute, Gerson Lehman Group, AlphaSights, Covance, Novartis, Genentech, Merck and Roche; is a shareholder in Personalis and NuMedii; is a minor shareholder in Apple, Facebook, Google, Microsoft, 10x Genomics, Amazon, Biogen, Illumina, Snap, Nuna Health, Royalty Pharma, Sanofi, AstraZeneca, Assay Depot, Vet24seven, Regeneron, Moderna and Sutro, many of which use AI and predictive modeling, and several other non-health-related companies and mutual funds; and has received honoraria and travel reimbursement for invited talks from Genentech, Takeda, Varian, Roche, Pfizer, Merck, Lilly, Mars, Siemens, Optum, Abbott, Celgene, AstraZeneca, AbbVie, Johnson & Johnson, Westat and many academic institutions, state or national agencies, medical or disease specific foundations and associations, and health systems. A.J.B. receives royalty payments through Stanford University for several patents and other disclosures licensed to NuMedii and Personalis. A.J.B. has research funded by the NIH, Northrup Grumman (as the prime on an NIH contract), Genentech, Johnson & Johnson, FDA, US Department of Defense, Robert Wood Johnson Foundation, Leon Lowenstein Foundation, Intervalien Foundation, Priscilla Chan and Mark Zuckerberg, Barbara and Gerson Bakar Foundation and, in the recent past, the March of Dimes, Juvenile Diabetes Research Foundation, California Governor’s Office of Planning and Research, California Institute for Regenerative Medicine, L’Oreal and Progenity.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Norgeot, B., Quer, G., Beaulieu-Jones, B.K. et al. Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist. Nat Med 26, 1320–1324 (2020). https://doi.org/10.1038/s41591-020-1041-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41591-020-1041-y

  • Springer Nature America, Inc.

This article is cited by

Search

Navigation