Skip to main content
SpringerLink
Log in

Optimizing CNN based model for thyroid nodule classification using data augmentation, segmentation and boundary detection techniques

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Thyroid nodule is an asymptomatic disorder which mostly occurs due to high production of thyroid hormones from the thyroid gland. The diagnosis is usually made by the radiologist and endocrinologists which heavily relies on their experience and expertise. Ultrasonography is one of the principal means for the initial assessment of nodules which is mainly performed when there is suspect of formation of nodules. In this research work, an optimized convolutional neural network model is proposed for the identification of thyroid nodules using various deep learning techniques like dense neural network, Alexnet, Resnet-50 and Visual geometry group-16. A total of 295 public and 654 collected thyroid ultrasonography datasets are considered in this work. The proposed model is evaluated on 1475 public and 3270 collected thyroid ultrasonography datasets with data augmentation technique. We experimentally determined the best optimized value for learning rate and drop out factor to enhance the performance of the models. The proposed model has achieved an accuracy of 93.75%, sensitivity of 94.62%, specificity of 92.53% and f-measure of 94.09% on the public dataset in experiment-I and an accuracy of 96.89%, sensitivity of 97.80%, specificity of 94.73% and f-measure of 97.26% on the collected dataset in experiment-II. The proposed model has shown an improvement of (4.57%, 7.84%), (5.06%, 8.24%), (4.43%, 6.63%) and (4.66%, 7.83%) in terms of accuracy, sensitivity, specificity and f-measure on (dataset −1, dataset-2) against other state of the art models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29
Fig. 30

Similar content being viewed by others

Data Availability

Not available due to ethics approval condition.

References

  1. Ajilisa, OA, Jagathyraj, VP, Sabu, MK (2020) Computer-Aided Diagnosis of Thyroid Nodule from Ultrasound Images Using Transfer Learning from Deep Convolutional Neural Network Models. In 2020 Advanced Computing and Communication Technologies for High Performance Applications (ACCTHPA) (pp 237–241). IEEE

  2. Al-Rahlawee ATH, Rahebi J (2021) Multilevel thresholding of images with improved Otsu thresholding by black widow optimization algorithm. Multimed Tools Appl 80(18):28217–28243

  3. Baldini E, Lauro A, Tripodi D, Pironi D, Amabile MI, Ferent IC, Ulisse S (2022) Thyroid Diseases and Breast Cancer. J Personal Med 12(2):156

  4. Das NN, Kumar N, Kaur M, Kumar V, Singh D (2020) Automated deep transfer learning-based approach for detection of COVID-19 infection in chest X-rays. Irbm

  5. Guo X, Zhao H, Tang Z (2020) An Improved Deep Learning Approach for Thyroid Nodule Diagnosis. In: 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI). IEEE, pp 296–299. https://doi.org/10.1109/ISBI45749.2020.9098637

  6. Gurunathan A, Krishnan B (2021) Detection and diagnosis of brain tumors using deep learning convolutional neural networks. Int J Imaging Syst Technol 31(3):1174–1184

    Article  Google Scholar 

  7. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  8. Ikebe M, Asai T (2005) A digital vision chip for early feature extraction with rotated template-matching CA. J Robot Mechatronics 17(4):372

    Article  Google Scholar 

  9. Ilhan U, Ilhan A (2017) Brain tumor segmentation based on a new threshold approach. Procedia Comput Sci 120:580–587. https://doi.org/10.1016/j.procs.2017.11.282

    Article  Google Scholar 

  10. Kaur M, Kumar V, Yadav V, Singh D, Kumar N, Das NN (2021) Metaheuristic-based deep COVID-19 screening model from chest X-ray images. J Healthcare Eng. https://doi.org/10.1155/2021/8829829

  11. Khan A, Sohail A, Zahoora U, Qureshi AS (2020) A survey of the recent architectures of deep convolutional neural networks. Artif Intell Rev 53(8):5455–5516

    Article  Google Scholar 

  12. Khan ID, Khan MH, Farooq O, Khan YU (2021) A Comparative Analysis of Seizure Detection via Scalogram using GoogLeNet, AlexNet and SqueezeNet. In 2021 Smart Technologies, Communication and Robotics (STCR) (pp 1–5). IEEE

  13. Khanna M, Agarwal A, Singh LK, Thawkar S, Khanna A, Gupta D (2021) Radiologist-Level Two Novel and Robust Automated Computer-Aided Prediction Models for Early Detection of COVID-19 Infection from Chest X-ray Images. Arab J Sci Eng, 1–33

  14. Ko SY, Lee JH, Yoon JH, Na H, Hong E, Han K, Kwak JY (2019) Deep convolutional neural network for the diagnosis of thyroid nodules on ultrasound. Head Neck 41(4):885–891

  15. Koundal D, Gupta S, Singh S (2018) Computer aided thyroid nodule detection system using medical ultrasound images. Biomed Signal Process Control 40:117–130. https://doi.org/10.1016/j.bspc.2017.08.025

    Article  Google Scholar 

  16. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Proces Syst 25:1097–1105. https://dl.acm.org/doi/10.5555/2999134.2999257

  17. Kumar N, Gupta M, Gupta D, Tiwari S (2021) Novel deep transfer learning model for COVID-19 patient detection using X-ray chest images. J Ambient Intell Humaniz Comput 14(1):469–478. https://doi.org/10.1007/s12652-021-03306-6

    Article  Google Scholar 

  18. Kumar N, Narayan Das N, Gupta D, Gupta K, Bindra J (2021) Efficient automated disease diagnosis using machine learning models J Healthcare Eng. https://doi.org/10.1155/2021/9983652

  19. Li C, Tofighi MR, Schreurs D, Horng TSJ (2016) Principles and applications of RF/microwave in healthcare and biosensing. Elsevier, Amsterdam

  20. Lu J, Ouyang X, Shen X, Liu T, Cui Z, Wang Q, Shen D (2022) GAN-Guided Deformable Attention Network for Identifying Thyroid Nodules in Ultrasound Images. IEEE J Biomed Health Inf 26(4):1582–1590. https://doi.org/10.1109/JBHI.2022.3153559

    Article  Google Scholar 

  21. Merzban MH, Elbayoumi M (2019) Efficient solution of Otsu multilevel image thresholding: A comparative study. Expert Syst Appl 116:299–309. https://doi.org/10.1016/j.eswa.2018.09.008

    Article  Google Scholar 

  22. Mohsen H, El-Dahshan ESA, El-Horbaty ESM, Salem ABM (2018) Classification using deep learning neural networks for brain tumors. Future Comput Inf J 3(1):68–71. https://doi.org/10.1016/j.fcij.2017.12.001

    Article  Google Scholar 

  23. Nguyen DT, Pham TD, Batchuluun G, Yoon HS, Park KR (2019) Artificial intelligence-based thyroid nodule classification using information from spatial and frequency domains. J Clin Med 8(11):1976

    Article  Google Scholar 

  24. Nguyen DT, Kang JK, Pham TD, Batchuluun G, Park KR (2021) Ultrasound image-based diagnosis of malignant thyroid nodule using artificial intelligence. Sensors 20(7):1822. https://doi.org/10.3390/s20071822

  25. Owais M, Arsalan M, Choi J, Park KR (2019) Effective diagnosis and treatment through content-based medical image retrieval (CBMIR) by using artificial intelligence. J Clin Med 8(4):462

    Article  Google Scholar 

  26. Park K, Chae M, Cho JH (2021) Image Pre-Processing Method of Machine Learning for Edge Detection with Image Signal Processor Enhancement. Micromachines 12(1):73

    Article  Google Scholar 

  27. Pedraza L, Vargas C, Narváez F, Durán O, Muñoz E, Romero E (2015) An open access thyroid ultrasound image database. In 10th International Symposium on Medical Information Processing and Analysis (Vol. 9287, p. 92870 W). Int Soc Opt Photon

  28. Quality Council of India (n.d.) [Online] Available: https://www.nabh.co/frmViewCGHSRecommend.aspx?Type=Diagnostic%20Centre&cityID=94. Accessed 07 Sept 2022

  29. Rai HM, Chatterjee K (2021) 2D MRI image analysis and brain tumor detection using deep learning CNN model LeU-Net. Multimed Tools Appl 80:36111–36141. https://doi.org/10.1007/s11042-021-11504-9

    Article  Google Scholar 

  30. Richman DM, Benson CB, Doubilet PM, Wassner AJ, Asch E, Cherella CE et al (2020) Assessment of American college of radiology thyroid imaging reporting and data system (TI-RADS) for pediatric thyroid nodules. Radiology 294(2):415–420. https://doi.org/10.1148/radiol.2019191326

    Article  Google Scholar 

  31. Rohith, G, Kumar, LS (2022) Design of Deep Convolution Neural Networks for categorical signature classification of raw panchromatic satellite images. Multimed Tools Appl, 1–38

  32. Ruggeri, RM, Giovanellla, L, Campennì, A (2022) SARS-CoV-2 vaccine may trigger thyroid autoimmunity: real-life experience and review of the literature. J Endocrinol Investig, 1–7

  33. Saba T (2021) Computer vision for microscopic skin cancer diagnosis using handcrafted and non-handcrafted features. Microsc Res Tech 84(6):1272–1283

    Article  Google Scholar 

  34. Saba T, Khan MA, Rehman A, Marie-Sainte SL (2019) Region extraction and classification of skin cancer: A heterogeneous framework of deep CNN features fusion and reduction. J Med Syst 43(9):1–19

    Article  Google Scholar 

  35. Shaban WM, Rabie AH, Saleh AI, Abo-Elsoud MA (2021) Detecting COVID-19 patients based on fuzzy inference engine and Deep Neural Network. Appl Soft Comput 99:106906. https://doi.org/10.1016/j.asoc.2020.106906

  36. Shi G, Wang J, Qiang Y, Yang X, Zhao J, Hao R, Kazihise NGF (2020) Knowledge-guided synthetic medical image adversarial augmentation for ultrasonography thyroid nodule classification. Comput Methods Prog Biomed 196(105):611

    Google Scholar 

  37. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  38. Song W, Li S, Liu J, Qin H, Zhang B, Zhang S, Hao A (2018) Multitask cascade convolution neural networks for automatic thyroid nodule detection and recognition. IEEE J Biomed Health Inf 23(3):1215–1224

    Article  Google Scholar 

  39. Srivastava R, Kuma P (2021) A hybrid model for the identification and classification of thyroid nodules in medical ultrasound images. Int J Modell, Identification and Control (IJMIC). [In Press]

  40. Tejas R (2022) Contour Detection & Edge Detection, Accessed: Sep. 03, 2022[Online], Available: https://medium.com/@tejas9723/contour-detection-edge-detection-with-opencv-96a74097e1f6

  41. Wang, J, Li, S, Song, W, Qin, H, Zhang, B, Hao, A (2018) Learning from weakly-labelled clinical data for automatic thyroid nodule classification in ultrasound images. In 2018 25th IEEE International Conference on Image Processing (ICIP). IEEE, pp 3114–3118. https://doi.org/10.1109/ICIP.2018.8451085

  42. Xie J, Guo L, Zhao C, Li X, Luo Y, Jianwei L (2020) A hybrid deep learning and handcrafted features based approach for thyroid nodule classification in ultrasound images. In J Phys Conf Ser (Vol. 1693, No. 1, p. 012160). IOP Publishing

  43. Xu Z, Sheykhahmad FR, Ghadimi N, Razmjooy N (2020) Computer-aided diagnosis of skin cancer based on soft computing techniques. Open Med 15(1):860–871

    Article  Google Scholar 

  44. Yang W, Dong Y, Du Q, Qiang Y, Wu K, Zhao J, Zia MB (2021) Integrate domain knowledge in training multi-task cascade deep learning model for benign–malignant thyroid nodule classification on ultrasound images. Eng Appl Artif Intell 98(104):064

    Google Scholar 

  45. Yao X, Wang X, Wang SH, Zhang YD (2020) A comprehensive survey on convolutional neural network in medical image analysis. Multimed Tools Appl, 1–45

  46. Zhao SX, Chen Y, Yang KF, Luo Y, Ma BY, Li YJ (2022) A Local and Global Feature Disentangled Network: Toward Classification of Benign-malignant Thyroid Nodules from Ultrasound Image. IEEE Trans Med Imaging

  47. Zhao X, Shen X, Wan W, Lu Y, Hu S, Xiao R, Li J (2022) Automatic Thyroid Ultrasound Image Classification Using Feature Fusion Network. IEEE Access 10:27,917–27,924

  48. Zhu YC, AlZoubi A, Jassim S, Jiang Q, Zhang Y, Wang YB, Hongbo DU (2021) A generic deep learning framework to classify thyroid and breast lesions in ultrasound images. Ultrasonics 110:106300. https://doi.org/10.1016/j.ultras.2020.106300

Download references

Funding

The authors have no relevant financial or non-financial interests to disclose.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Jaypee University of Information Technology, Waknaghat, Dist. Solan, HP, India

    Rajshree Srivastava & Pardeep Kumar

Authors
  1. Rajshree Srivastava
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pardeep Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pardeep Kumar.

Ethics declarations

Conflict of interest

We declare no conflict of interest.

Research involving human participants and/or animals

In this study there is no involvement of human participants and/or Animals.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1 Algorithm for data pre-processing and data augmentation techniques

Algorithm 1
figure a

Data pre-processing and data augmentation techniques

Full size image

Appendix 2 Algorithm for morphological operation, segmentation and boundary detection

Algorithm 2
figure b

Morphological operation, segmentation and boundary detection

Full size image

Appendix 3 Algorithm for classification of thyroid nodules using CNN

Algorithm 3
figure c

Classification using CNN

Full size image

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Srivastava, R., Kumar, P. Optimizing CNN based model for thyroid nodule classification using data augmentation, segmentation and boundary detection techniques. Multimed Tools Appl 82, 41037–41072 (2023). https://doi.org/10.1007/s11042-023-15068-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-15068-8

Keywords

Search

Navigation