A new computational method for the detection of virus particles in transmission electron microscopy (TEM) images is presented. Our approach is to use a convolutional neural network that transforms a TEM image to a probabilistic map that indicates where virus particles exist in the image. Our proposed approach automatically and simultaneously learns both discriminative features and classifier for virus particle detection by machine learning, in contrast to existing methods that are based on handcrafted features that yield many false positives and require several postprocessing steps. The detection performance of the proposed method was assessed against a dataset of TEM images containing feline calicivirus particles and compared with several existing detection methods, and the state-of-the-art performance of the developed method for detecting virus was demonstrated. Since our method is based on supervised learning that requires both the input images and their corresponding annotations, it is basically used for detection of already-known viruses. However, the method is highly flexible, and the convolutional networks can adapt themselves to any virus particles by learning automatically from an annotated dataset.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Bosch, A., Guix, S., Sano, D., & Pinto, R. M. (2008). New tools for the study and direct surveillance of viral pathogens in water. Current Opinion in Biotechnology, 19, 295–310.
Bradski, G. (2000). The OpenCV library. Dr. Dobb’s Journal of Software Tools, 120, 122–125.
Ciresan, D., Giusti, A., Gambardella, L. M., & Schmidhuber, J. (2012). Deep neural networks segment neuronal membranes in electron microscopy images. In Proceedings of the Advances in Neural Information Processing Systems (pp. 2843–2851).
Ciresan, D. C., Giusti, A., Gambardella, L. M., & Schmidhuber, J. (2013). Mitosis detection in breast cancer histology images with deep neural networks. In International Conference on Medical Image Computing and Computer-assisted Intervention (pp. 411–418). Berlin, Heidelberg: Springer.
Doane, F. W. (1980). Virus morphology as an aid for rapid diagnosis. The Yale Journal of Biology and Medicine, 53(1), 19–25.
Havaei, M., Davy, A., Warde-Farley, D., Biard, A., Courville, A., Bengio, Y., et al. (2017). Brain tumor segmentation with deep neural networks. Medical Image Analysis, 35, 18–31.
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012). Improving neural networks by preventing co-adaptation of feature detectors. arXiv Preprint arXiv:1207.0580.
Ioffe, S., & Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv Preprint arXiv:1502.03167.
Ishii, S., Kitamura, G., Segawa, T., Kobayashi, A., Miura, T., Sano, D., et al. (2014). Microfluidic quantitative PCR for simultaneous quantification of multiple viruses in environmental water samples. Applied and Environmental Microbiology, 80(24), 7505–7511.
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. In Proceedings of the Advances in Neural Information Processing Systems (pp. 1097–1105).
Kylberg, G., Uppström, M., Hedlund, K. O., Borgefors, G., & Sintorn, I. M. (2012). Segmentation of virus particle candidates in transmission electron microscopy images. Journal of Microscopy, 245(2), 140–147.
Kylberg, G., Uppström, M., & Sintorn, I. M. (2011). Virus texture analysis using local binary patterns and radial density profiles. In Proceedings of the Iberoamerican Congress on Pattern Recognition (pp. 573–580). Berlin, Heidelberg: Springer.
LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278–2324.
Martin, I. M. B., Marinescu, D. C., Lynch, R. E., & Baker, T. S. (1997). Identification of spherical virus particles in digitized images of entire electron micrographs. Journal of Structural Biology, 120(2), 146–157.
Matuszewski, B. J. & Shark, L. K. (2001). Hierarchical iterative Bayesian approach to automatic recognition of biological viruses in electron microscope images. In Proceedings of the 2001 International Conference on Image Processing (Vol. 2, pp. 347–350). IEEE.
Matuszewski, B., Shark, L. K., & Hall, G. (1997). A novel segmentation and classification method for identification of viruses in electron microscope images. In Proceedings of the Sixth International Conference on Image Processing and Its Applications (Vol. 2, pp. 819–823). IET.
Nicholson, W. V., & Glaeser, R. M. (2001). Review: Automatic particle detection in electron microscopy. Journal of Structural Biology, 133(2–3), 90–101.
Ong, H., & Chandran, V. (2005). Identification of gastroenteric viruses by electron microscopy using higher order spectral features. Journal of Clinical Virology, 34(3), 195–206.
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., et al. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12, 2825–2830.
Proença, Md C M S, Nunes, J. F. M., & de Matos, A. P. A. (2013). Automatic virus particle selection—the entropy approach. IEEE Transactions on Image Processing, 22(5), 1996–2003.
Roingeard, P. (2008). Viral detection by electron microscopy: Past, present and future. Biology of the Cell, 100(8), 491–501.
Ryner, M., Strömberg, J. O., Söderberg-Nauclér, C., & Homman-Loudiyi, M. (2006). Identification and classification of human cytomegalovirus capsids in textured electron micrographs using deformed template matching. Virology Journal, 3(1), 57.
Schramlová, J., Arientova, S., & Hulinska, D. (2010). The role of electron microscopy in the rapid diagnosis of viral infections—review. Folia Microbiologica, 55(1), 88–101.
Sintorn, I. M., Homman-Loudiyi, M., Söderberg-Nauclér, C., & Borgefors, G. (2004). A refined circular template matching method for classification of human cytomegalovirus capsids in TEM images. Computer Methods and Programs in Biomedicine, 76(2), 95–102.
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2014). Dropout: A simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, 15(1), 1929–1958.
Thi Nguyen, H.-T., Nakagomi, T., Sano, D., Sherchand, J. B., Pandey, B. D., Cunliffe, N. A., et al. (2015). Molecular epidemiology of noroviruses detected in Nepalese children with acute diarrhea between 2005 and 2011: Increase and predominance of minor genotype GII.13. Infection, Genetics and Evolution, 30, 27–36.
van der Walt, S., Schönberger, J. L., Nunez-Iglesias, J., Boulogne, F., Warner, J. D., Yager, N., et al. (2014). scikit-image: Image processing in Python. PeerJ, 2, e453.
Wan, L., Zeiler, M., Zhang, S., Cun, Y. L., & Fergus, R. (2013). Regularization of neural networks using DropConnect. In Proceedings of the 30th International Conference on Machine Learning (ICML-13) (pp. 1058–1066).
Wu, H., & Gu, X. (2015). Towards dropout training for convolutional neural networks. Neural Networks, 71, 1–10.
This work was supported by the Japan Society for the Promotion of Science through Grants-in-Aid for Scientific Research (A) (17H01299) and (C) (15K00591).
Electronic supplementary material
Below is the link to the electronic supplementary material.
About this article
Cite this article
Ito, E., Sato, T., Sano, D. et al. Virus Particle Detection by Convolutional Neural Network in Transmission Electron Microscopy Images. Food Environ Virol 10, 201–208 (2018). https://doi.org/10.1007/s12560-018-9335-7
- Feline calicivirus
- Virus detection
- Transmission electron microscopy
- Image processing
- Convolutional neural network
- Machine learning