Skip to main content
SpringerLink
Log in

A Deep Learning-Based Approach for Cervical Cancer Classification Using 3D CNN and Vision Transformer

  • Published:
Journal of Imaging Informatics in Medicine Aims and scope Submit manuscript

Abstract

Cervical cancer is a significant health problem worldwide, and early detection and treatment are critical to improving patient outcomes. To address this challenge, a deep learning (DL)-based cervical classification system is proposed using 3D convolutional neural network and Vision Transformer (ViT) module. The proposed model leverages the capability of 3D CNN to extract spatiotemporal features from cervical images and employs the ViT model to capture and learn complex feature representations. The model consists of an input layer that receives cervical images, followed by a 3D convolution block, which extracts features from the images. The feature maps generated are down-sampled using max-pooling block to eliminate redundant information and preserve important features. Four Vision Transformer models are employed to extract efficient feature maps of different levels of abstraction. The output of each Vision Transformer model is an efficient set of feature maps that captures spatiotemporal information at a specific level of abstraction. The feature maps generated by the Vision Transformer models are then supplied into the 3D feature pyramid network (FPN) module for feature concatenation. The 3D squeeze-and-excitation (SE) block is employed to obtain efficient feature maps that recalibrate the feature responses of the network based on the interdependencies between different feature maps, thereby improving the discriminative power of the model. At last, dimension minimization of feature maps is executed using 3D average pooling layer. Its output is then fed into a kernel extreme learning machine (KELM) for classification into one of the five classes. The KELM uses radial basis kernel function (RBF) for mapping features in high-dimensional feature space and classifying the input samples. The superiority of the proposed model is known using simulation results, achieving an accuracy of 98.6%, demonstrating its potential as an effective tool for cervical cancer classification. Also, it can be used as a diagnostic supportive tool to assist medical experts in accurately identifying cervical cancer in patients.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Availability of Data and Material

Data sharing is not applicable to this article as no new data were created or analyzed in this study.

Code Availability

Not applicable.

References

  1. Khamparia A, Gupta D, Rodrigues JJ, de Albuquerque VHC: DCAVN: Cervical cancer prediction and classification using deep convolutional and variational autoencoder network. Multimedia Tools and Applications 80: 30399-30415, 2021.

    Article  Google Scholar 

  2. Tripathi A, Arora A, Bhan A: Classification of cervical cancer using Deep Learning Algorithm. In 2021 5th International Conference on Intelligent Computing and Control Systems (ICICCS) 1210–1218, 2021. IEEE.

  3. Alquran H, Mustafa WA, Qasmieh IA, Yacob YM, Alsalatie M, Al-Issa Y, Alqudah AM: Cervical cancer classification using combined machine learning and deep learning approach. Comput. Mater. Contin 72(3): 5117-5134, 2022.

    Google Scholar 

  4. Diniz DN, Rezende MT, Bianchi AG, Carneiro CM, Ushizima DM, de Medeiros FN, Souza MJ: A hierarchical feature-based methodology to perform cervical cancer classification. Applied Sciences 11(9): 4091, 2021.

    Article  CAS  Google Scholar 

  5. Gupta S, Gupta MK: Computational prediction of cervical cancer diagnosis using ensemble-based classification algorithm. The Computer Journal 65(6): 1527-1539, 2022.

    Article  MathSciNet  Google Scholar 

  6. Senthilkumar G, Ramakrishnan J, Frnda J, Ramachandran M, Gupta D, Tiwari P, Shorfuzzaman M, Mohammed MA: Incorporating artificial fish swarm in ensemble classification framework for recurrence prediction of cervical cancer. IEEE Access 9: 83876-83886, 2021.

    Article  Google Scholar 

  7. Bingol H: NCA‐based hybrid convolutional neural network model for classification of cervical cancer on gauss‐enhanced pap‐smear images. International Journal of Imaging Systems and Technology 32(6): 1978-1989, 2022.

    Article  Google Scholar 

  8. Dhawan S, Singh K, Arora M: Cervix image classification for prognosis of cervical cancer using deep neural network with transfer learning. EAI Endorsed Transactions on Pervasive Health and Technology 7(27), 2021.

  9. Akbar H, Anwar N, Rohajawati S, Yulfitri A, Kaurani HS: Optimizing AlexNet using Swarm Intelligence for Cervical Cancer Classification. In 2021 International Symposium on Electronics and Smart Devices (ISESD) 1–6, 2021. IEEE.

  10. Lavanya Devi N, Thirumurugan P: Cervical Cancer Classification from Pap Smear Images Using Modified Fuzzy C Means, PCA, and KNN. IETE Journal of Research 68(3): 1591-1598, 2022.

    Article  Google Scholar 

  11. Lu J, Song E, Ghoneim A, Alrashoud M: Machine learning for assisting cervical cancer diagnosis: An ensemble approach. Future Generation Computer Systems 106: 199-205, 2020

    Article  Google Scholar 

  12. Mehmood M, Rizwan M, Gregus ml M, Abbas S: Machine learning assisted cervical cancer detection. Frontiers in public health 9: 788376, 2021

    Article  PubMed  PubMed Central  Google Scholar 

  13. Chauhan NK, Singh K: Performance assessment of machine learning classifiers using selective feature approaches for cervical cancer detection. Wireless Personal Communications 124(3): 2335-2366, 2022.

    Article  Google Scholar 

  14. Nithya B, Ilango V: Evaluation of machine learning based optimized feature selection approaches and classification methods for cervical cancer prediction. SN Applied Sciences 1:1-16, 2019

    Article  Google Scholar 

  15. Wentzensen N, Lahrmann B, Clarke MA, Kinney W, Tokugawa D, Poitras N, Locke A, Bartels L, Krauthoff A, Walker J, Zuna R: Accuracy and efficiency of deep-learning–based automation of dual stain cytology in cervical Cancer screening. JNCI: Journal of the National Cancer Institute 113(1): 72–79, 2021

  16. Ratul IJ, Al-Monsur A, Tabassum B, Ar-Rafi AM, Nishat MM, Faisal F: Early risk prediction of cervical cancer: A machine learning approach. In 2022 19th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON) 1–4, 2022. IEEE.

  17. Elakkiya R, Teja KSS, Jegatha Deborah L, Bisogni C, Medaglia C: Imaging based cervical cancer diagnostics using small object detection-generative adversarial networks. Multimedia Tools and Applications 1–17, 2022

  18. Guo C, Wang J, Wang Y, Qu X, Shi Z, Meng Y, Qiu J, Hua K, Novel artificial intelligence machine learning approaches to precisely predict survival and site-specific recurrence in cervical cancer: a multi-institutional study. Translational Oncology 14(5): 101032, 2021

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Kalbhor M, Shinde S, Popescu DE, Hemanth DJ: Hybridization of Deep Learning Pre-Trained Models with Machine Learning Classifiers and Fuzzy Min–Max Neural Network for Cervical Cancer Diagnosis. Diagnostics 13(7): 1363, 2023.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Ghoneim A, Muhammad G, Hossain MS: Cervical cancer classification using convolutional neural networks and extreme learning machines. Future Generation Computer Systems 102: 643-649, 2020.

    Article  Google Scholar 

  21. A Mansouri, R, Ragab M: Equilibrium Optimization Algorithm with Ensemble Learning Based Cervical Precancerous Lesion Classification Model. In Healthcare 11(1): 55, 2023, January. Multidisciplinary Digital Publishing Institute.

  22. Kavitha R, Jothi DK, Saravanan K, Swain MP, Gonzáles JLA, Bhardwaj RJ, Adomako E: Ant Colony Optimization-Enabled CNN Deep Learning Technique for Accurate Detection of Cervical Cancer. BioMed Research International 2023, 2023.

  23. Chen X, Pu X, Chen Z, Li L, Zhao KN, Liu H, Zhu H: Application of EfficientNet‐B0 and GRU‐based deep learning on classifying the colposcopy diagnosis of precancerous cervical lesions. Cancer Medicine 2023.

  24. Pramanik R, Biswas M, Sen S, de Souza Júnior LA, Papa JP, Sarkar R: A fuzzy distance-based ensemble of deep models for cervical cancer detection. Computer Methods and Programs in Biomedicine 219: 106776, 2022.

    Article  PubMed  Google Scholar 

  25. Zhao C, Shuai R, Ma L, Liu W, Wu M: Improving cervical cancer classification with imbalanced datasets combining taming transformers with T2T-ViT. Multimedia tools and applications 81(17): 24265-24300, 2022.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Alquran H, Alsalatie M, Mustafa WA, Abdi RA, Ismail AR: Cervical Net: A Novel Cervical Cancer Classification Using Feature Fusion. Bioengineering 9(10): 578, 2022.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Huang YS, Wang TC, Huang SZ, Zhang J, Chen HM, Chang YC, Chang RF: An improved 3-D attention CNN with hybrid loss and feature fusion for pulmonary nodule classification. Computer Methods and Programs in Biomedicine 229: 107278, 2023.

    Article  PubMed  Google Scholar 

  28. Asiri AA, Shaf A, Ali T, Shakeel U, Irfan M, Mehdar KM, Halawani HT, Alghamdi AH, Alshamrani AFA, Alqhtani SM: Exploring the Power of Deep Learning: Fine-Tuned Vision Transformer for Accurate and Efficient Brain Tumor Detection in MRI Scans. Diagnostics 13(12): 2094, 2023.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Gong J, Yang X, Wang H, Shen J, Liu W, Zhou F: Coordinated method fusing improved bubble entropy and artificial Gorilla Troops Optimizer optimized KELM for rolling bearing fault diagnosis. Applied Acoustics 195: 108844, 2022.

    Article  Google Scholar 

  30. Chowdhury Y.S: Herlev Dataset. Kaggle. Retrieved April 18, 2023, from https://www.kaggle.com/datasets/yuvrajsinhachowdhury/herlev-dataset. (2022, March 24).

Download references

Author information

Authors and Affiliations

  1. Department of Computing Technologies, SRM Institute of Science and Technology, Kattankulathur, Chennai, India

    Abinaya K. & Sivakumar B.

Authors
  1. Abinaya K.
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sivakumar B.
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors agreed on the content of the study. A.K. and S.B. collected all the data for analysis. A.K. agreed on the methodology. A.K. and S.B. completed the analysis based on agreed steps. Results and conclusions are discussed and written together. The author read and approved the final manuscript.

Corresponding author

Correspondence to Abinaya K..

Ethics declarations

Ethics Approval

This article does not contain any studies with human participants or animal subjects performed by any of the authors.

Consent to Participate

Informed consent was obtained from all individual participants included in the study.

Consent for Publication

Not applicable.

Competing Interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

K., A., B., S. A Deep Learning-Based Approach for Cervical Cancer Classification Using 3D CNN and Vision Transformer. J Digit Imaging. Inform. med. 37, 280–296 (2024). https://doi.org/10.1007/s10278-023-00911-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10278-023-00911-z

Keywords

Search

Navigation