The field of bioimage analysis is poised for a major transformation, owing to advancements in imaging technologies and artificial intelligence. The emergence of multimodal foundation models — which are akin to large language models (such as ChatGPT) but are capable of comprehending and processing biological images — holds great potential for ushering in a revolutionary era in bioimage analysis.
This is a preview of subscription content, log in via an institution to check access.
References
Li, W., Maekiniemi, A., Sato, H., Osman, C. & Singer, R. H. Nat. Methods 19, 1558–1562 (2022).
Yeh, L.-H. et al. Preprint at bioRxiv https://doi.org/10.1101/2020.12.15.422951 (2021).
Tang, P. et al. Light Sci. Appl. 10, 237 (2021).
Hobson, C. M., Aaron, J. S., Heddleston, J. M. & Chew, T.-L. Front. Cell Dev. Biol. 9, 706126 (2021).
Antonacci, G. et al. Biophys. Rev. 12, 615–624 (2020).
Fujiwara, M. et al. Carbon 198, 57–62 (2022).
Slenders, E. et al. Light Sci. Appl. 10, 31 (2021).
Popkin, G. Nature 529, 16–18 (2016).
Pachitariu, M. & Stringer, C. Nat. Methods 19, 1634–1641 (2022).
Schmidt, U., Weigert, M., Broaddus, C. & Myers, G. Cell detection with star-convex polygons. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2018 (eds. Frangi, A. F. et al. 265–273 (Springer International, 2018).
Ditchburn, R. W. & Drysdale, A. E. Vision Res. 13, 2423–2433 (1973).
Brown, T. B. et al. Preprint at https://doi.org/10.48550/arXiv.2005.14165 (2020).
Kobayashi, H., Cheveralls, K. C., Leonetti, M. D. & Royer, L. A. Nat. Methods 19, 995–1003 (2022).
Fang, Y. et al. Preprint at https://doi.org/10.48550/arXiv.2211.07636 (2022).
Yuan, L. et al. Preprint at https://doi.org/10.48550/arXiv.2111.11432 (2021).
Radford, A. et al. Preprint at https://doi.org/10.48550/arXiv.2103.00020 (2021).
Caron, M. et al. Emerging properties in self-supervised vision transformers. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV) 9630–9640 (IEEE, 2021).
Wu, C. et al. Preprint at https://doi.org/10.48550/arXiv.2303.04671 (2023).
Tay, Y. et al. Preprint at https://doi.org/10.48550/arXiv.2210.11399 (2022).
Xiao, G. et al. Preprint at https://doi.org/10.48550/arXiv.2211.10438 (2022).
Frantar, E. & Alistarh, D. Preprint at https://doi.org/10.48550/arXiv.2301.00774 (2023).
Acknowledgements
I thank S. Schmid, K. Balla, J. Bragantini, A. Jacobo, M. Lange and S. Mehta for proofreading and feedback.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The author declares no competing interests.
Rights and permissions
About this article
Cite this article
Royer, L.A. The future of bioimage analysis: a dialog between mind and machine. Nat Methods 20, 951–952 (2023). https://doi.org/10.1038/s41592-023-01930-y
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41592-023-01930-y
- Springer Nature America, Inc.