Abstract
The paper examines the possibilities of using synthetic HEp-2 cell images as a means of data augmentation. The common problem of biomedical datasets is the shortage of annotated samples required for the training of deep learning techniques. Traditional approaches based on image rotation and mirroring have their limitations, and alternative techniques based on generative adversarial networks (GANs) are currently being explored. Instead of looking solely at a single dataset or the creation of a recognition model with applicability for multiple datasets, this study focuses on the transferability of synthetic HEp-2 samples among publicly available datasets. The paper offers a workflow where the quality of synthetic samples is confirmed via an independent fine-tuned neural network. The subsequent combination of synthetic samples with original images outperforms traditional augmentation approaches and leads to state-of-the-art performance on both publicly available HEp-2 cell image datasets employed in this study.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bajić, B., Majtner, T., Lindblad, J., Sladoje, N.: Generalised deep learning framework for HEp-2 cell recognition using local binary pattern maps. IET Image Proc. 14(6), 1201–1208 (2020)
Bayramoglu, N., Kannala, J., Heikkilä, J.: Human epithelial type 2 cell classification with convolutional neural networks. In: 15th International Conference on Bioinformatics and Bioengineering, pp. 1–6. IEEE (2015)
Bowles, C., et al.: GAN augmentation: augmenting training data using generative adversarial networks. arXiv preprint arXiv:1810.10863 (2018)
Cascio, D., Taormina, V., Cipolla, M., Bruno, S., Fauci, F., Raso, G.: A multi-process system for HEp-2 cells classification based on SVM. Pattern Recogn. Lett. 82, 56–63 (2016)
Faraki, M., Harandi, M., Wiliem, A., Lovell, B.: Fisher tensors for classifying human epithelial cells. Pattern Recogn. 47(7), 2348–2359 (2014)
Gao, Z., Wang, L., Zhou, L., Zhang, J.: HEp-2 cell image classification with deep convolutional neural networks. IEEE J. Biomed. Health Inform. 21(2), 416–428 (2017)
Goodfellow, I.J., et al.: Generative adversarial networks. arXiv preprint arXiv:1406.2661 (2014)
Harandi, M., Lovell, B., Percannella, G., Saggese, A., Vento, M., Wiliem, A.: Executable thematic special issue on pattern recognition techniques for indirect immunofluorescence images analysis. Pattern Recogn. Lett. 82, 1–2 (2016)
Hobson, P., Lovell, B., Percannella, G., Vento, M., Wiliem, A.: Benchmarking human epithelial type 2 interphase cells classification methods on a very large dataset. Artif. Intell. Med. 65(3), 239–250 (2015)
Lei, H., et al.: A deeply supervised residual network for HEp-2 cell classification via cross-modal transfer learning. Pattern Recogn. 79, 290–302 (2018)
Li, Y., Shen, L.: HEp-Net: a smaller and better deep-learning network for HEp-2 cell classification. Comput. Methods Biomech. Biomed. Eng. Imaging Vis. 7(3), 266–272 (2019)
Majtner, T., Bajić, B., Herp, J.: Texture-based image transformations for improved deep learning classification. In: 25th Iberoamerican Congress on Pattern Recognition. Springer (2021)
Majtner, T., Bajić, B., Lindblad, J., Sladoje, N., Blanes-Vidal, V., Nadimi, E.S.: On the effectiveness of generative adversarial networks as HEp-2 image augmentation tool. In: Felsberg, M., Forssén, P.-E., Sintorn, I.-M., Unger, J. (eds.) SCIA 2019. LNCS, vol. 11482, pp. 439–451. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-20205-7_36
Meroni, P.L., Schur, P.H.: ANA screening: an old test with new recommendations. Ann. Rheum. Dis. 69(8), 1420–1422 (2010)
Park, D., Park, H., Han, D.K., Ko, H.: Single image dehazing with image entropy and information fidelity. In: International Conference on Image Processing, pp. 4037–4041. IEEE (2014)
Qi, X., Zhao, G., Chen, J., Pietikäinen, M.: HEp-2 cell classification: the role of Gaussian scale space theory as a pre-processing approach. Pattern Recogn. Lett. 82, 36–43 (2016)
Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434 (2015)
Shen, L., Jia, X., Li, Y.: Deep cross residual network for HEp-2 cell staining pattern classification. Pattern Recogn. 82, 68–78 (2018)
Vununu, C., Lee, S.H., Kwon, K.R.: A deep feature extraction method for HEp-2 cell image classification. Electronics 8(1), 20 (2019)
Wetzer, E., Lindblad, J., Sintorn, I.-M., Hultenby, K., Sladoje, N.: Towards automated multiscale imaging and analysis in TEM: glomerulus detection by fusion of CNN and LBP maps. In: Leal-Taixé, L., Roth, S. (eds.) ECCV 2018. LNCS, vol. 11134, pp. 465–475. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-11024-6_36
Wiliem, A., Sanderson, C., Wong, Y., Hobson, P., Minchin, R., Lovell, B.: Automatic classification of human epithelial type 2 cell indirect immunofluorescence images using cell pyramid matching. Pattern Recog. 47(7), 2315–2324 (2014)
Wiliem, A., Wong, Y., Sanderson, C., Hobson, P., Chen, S., Lovell, B.: Classification of human epithelial type 2 cell indirect immunofluoresence images via codebook based descriptors. In: Workshop on Applications of Computer Vision, pp. 95–102. IEEE (2013)
Xie, H., He, Y., Lei, H., Han, T., Yu, Z., Lei, B.: Deeply supervised residual network for HEp-2 cell classification. In: 24th International Conference on Pattern Recognition (ICPR), pp. 699–703. IEEE (2018)
Yang, Y., Wiliem, A., Alavi, A., Hobson, P.: Classification of human epithelial type 2 cell images using independent component analysis. In: 20th International Conference on Image Processing, pp. 733–737. IEEE (2013)
Yi, X., Walia, E., Babyn, P.: Generative adversarial network in medical imaging: a review. Med. Image Anal. 58, 101552 (2019)
Zuiderveld, K.: Contrast limited adaptive histogram equalization. In: Graphics Gems IV, pp. 474–485. Academic Press Professional (1994)
Acknowledgement
The work was supported from European Regional Development Fund-Project “Postdoc2@MUNI” (No. CZ.02.2.69/0.0/0.0/18\(\_\)053/ 0016952).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Majtner, T. (2021). HEp-2 Cell Image Recognition with Transferable Cross-Dataset Synthetic Samples. In: Tsapatsoulis, N., Panayides, A., Theocharides, T., Lanitis, A., Pattichis, C., Vento, M. (eds) Computer Analysis of Images and Patterns. CAIP 2021. Lecture Notes in Computer Science(), vol 13052. Springer, Cham. https://doi.org/10.1007/978-3-030-89128-2_21
Download citation
DOI: https://doi.org/10.1007/978-3-030-89128-2_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-89127-5
Online ISBN: 978-3-030-89128-2
eBook Packages: Computer ScienceComputer Science (R0)