We dream of a future where light microscopes have new capabilities: language-guided image acquisition, automatic image analysis based on extensive prior training from biologist experts, and language-guided image analysis for custom analyses. Most capabilities have reached the proof-of-principle stage, but implementation would be accelerated by efforts to gather appropriate training sets and make user-friendly interfaces.
This is a preview of subscription content, log in via an institution to check access.
References
Rueden, C. T. et al. PLoS Biol. 17, e3000340 (2019).
Schneider, C. A., Rasband, W. S. & Eliceiri, K. W. Nat. Methods 9, 671–675 (2012).
Carpenter, A. E. et al. Genome Biol. 7, R100 (2006).
Scherf, N. & Huisken, J. Nat. Biotechnol. 33, 815–818 (2015).
Strack, R. Nat. Methods 17, 23 (2020).
Royer, L. A. et al. Nat. Biotechnol. 34, 1267–1278 (2016).
Carpenter, A. E., Ashouri, A. & Belmont, A. S. Cytometry A 58, 157–166 (2004).
Conrad, C. et al. Nat. Methods 8, 246–249 (2011).
Mahecic, D. et al. Nat. Methods 19, 1262–1267 (2022).
Pinkard, H. & Waller, L. Nat. Methods 19, 1175–1176 (2022).
Caicedo, J. C. et al. Nat. Methods 16, 1247–1253 (2019).
Schmidt, U., Weigert, M., Broaddus, C. & Myers, G. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2018 265–273 (Springer International, 2018).
Pachitariu, M. & Stringer, C. Nat. Methods 19, 1634–1641 (2022).
Greenwald, N. F. et al. Nat. Biotechnol. 40, 555–565 (2022).
Sommer, C., Straehle, C., Kothe, U. & Hamprecht, F. A. In 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro 230–233 (IEEE, 2011); https://doi.org/10.1109/ISBI.2011.5872394
Ouyang, W., Mueller, F., Hjelmare, M., Lundberg, E. & Zimmer, C. Nat. Methods 16, 1199–1200 (2019).
Gómez-de-Mariscal, E. et al. Nat. Methods 18, 1192–1195 (2021).
Weigert, M. et al. Nat. Methods 15, 1090–1097 (2018).
von Chamier, L. et al. Nat. Commun. 12, 2276 (2021).
Brown, T. et al. Adv. Neural Inf. Process. Syst. 33, 1877–1901 (2020).
Bengio, Y., Courville, A. & Vincent, P. Preprint at arXiv https://doi.org/10.48550/arXiv.1206.5538 (2012).
Markov, T. et al. Preprint at arXiv https://doi.org/10.48550/arXiv.2208.03274 (2022).
Ouyang, L. et al. Preprint at arXiv https://doi.org/10.48550/arXiv.2203.02155 (2022).
Qin, C. et al. Preprint at arXiv https://doi.org/10.48550/arXiv.2302.06476 (2023).
Gozalo-Brizuela, R. & Garrido-Merchan, E. C. Preprint at arXiv https://doi.org/10.48550/arXiv.2301.04655 (2023).
Acknowledgements
This work was supported by the National Institutes of Health (NIH P41 GM135019 to A.E.C., B.A.C. and K.W.E.).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Peer review
Peer review information
Nature Methods thanks Henry Pinkard for his contribution to the peer review of this work.
Rights and permissions
About this article
Cite this article
Carpenter, A.E., Cimini, B.A. & Eliceiri, K.W. Smart microscopes of the future. Nat Methods 20, 962–964 (2023). https://doi.org/10.1038/s41592-023-01912-0
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41592-023-01912-0
- Springer Nature America, Inc.
This article is cited by
-
Bringing computation to biology by bridging the last mile
Nature Cell Biology (2024)
-
Imagining the future of optical microscopy: everything, everywhere, all at once
Communications Biology (2023)