Skip to main content
SpringerLink
Log in

Multi-stage Deep Convolutional Neural Network for Histopathological Analysis of Osteosarcoma

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Osteosarcoma has the highest incidence rate among malignant bone tumours. It is particularly detrimental to human health because it is a highly malignant tumour. Also makes up 40% of initial malignant bone tumours while having a 3–10 per million incidences. High mortality and morbidity rates are associated with osteosarcoma, particularly in underdeveloped nations. To increase patient survival, early osteosarcoma screening and diagnosis are essential. In this study, we suggest a novel encoder–decoder method that associations nested connections and an effective attention mechanism. The encoder, decoder, and skip connection make up the model's structure. The DropBlock regularization technique makes it easier to discard local semantic information while still encouraging the network to learn resilient and useful features. An effective attention module leverages the right kind of cross-channel contact to collect more detailed global data. In the skip connection section, the semantic gap left by a direct simple connection is filled by using the nested connection method to combine the feature maps obtained from the intermediate decoder with the original feature maps from the encoder. The original image is then enhanced with data to increase robustness and avoid the over-fitting issue brought on by insufficient data. Three separate data sets and a variety of performance indicators are used to examine the robustness of the proposed model. The suggested model outperforms other current models thanks to its strong performance, achieving an average accuracy of 99.13%. Here, Datasets 1, 2, and 3 each have an accuracy of 99.67%, 98.16%, and 99.76%, respectively. The investigational results show that our proposed method can significantly progress the presence of convolutional neural networks and state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Data availability

In this article, publicly available datasets are used for training, testing, and validation purpose.

References

  1. Rajani R, Gibbs CP (2012) Treatment of bone tumors. Surg Pathol Clin 5:301–318. https://doi.org/10.1016/j.path.2011.07.015

    Article  Google Scholar 

  2. Broadhead ML, Clark JCM, Myers DE, Dass CR, Choong PFM (2011) The molecular pathogenesis of osteosarcoma: a review. Sarcoma 2011:1–12. https://doi.org/10.1155/2011/959248

    Article  Google Scholar 

  3. Eaton BR, Schwarz R, Vatner R, Yeh B, Claude L, Indelicato DJ, Laack N (2021) Osteosarcoma. Pediatr Blood Cancer 68(Suppl. S2):e28352

    Article  Google Scholar 

  4. Liu F, Gou F, Wu J (2022) An attention-preserving network-based method for assisted segmentation of osteosarcoma MRI images. Mathematics 10:1665

    Article  Google Scholar 

  5. Zhou L, Tan Y (2022) a residual fusion network for osteosarcoma MRI image segmentation in developing countries. Comput Intell Neurosci 2022:7285600

    Google Scholar 

  6. Rathore R, van Tine BA (2021) Pathogenesis and current treatment of osteosarcoma: perspectives for future therapies. J Clin Med 10:1182

    Article  Google Scholar 

  7. Wang L, Yu L, Zhu J, Tang H (2022) Auxiliary segmentation method of osteosarcoma in MRI images based on denoising and local enhancement. Healthcare 10:1468

    Article  Google Scholar 

  8. Fei F, Harada S, Wei S, Siegal GP (2022) Chapter 40—molecular pathology of osteosarcoma. In: Heymann D (ed) Bone sarcomas and bonemetastases—from bench to bedside, 3rd edn. Elsevier, Amsterdam, pp 579–590

    Google Scholar 

  9. Namboodiri S, Jayachandran A (2020) Multi-class skin lesions classification system using probability map based region growing and DCNN. Int J Comput Intell Syst 13(1):77–84

    Article  Google Scholar 

  10. Ming Y, Wu N, Qian T, Li X, Wan DQ, Li C, Li Y, Wu Z, Wang X, Liu J, Wu N (2020) Progress and future trends in PET/CT and PET/MRI molecular imaging approaches for breast cancer. Front Oncol 10:1301. https://doi.org/10.3389/fonc.2020.01301

    Article  Google Scholar 

  11. Beyer T, Bidaut L, Dickson J, Kachelriess M, Kiessling F, Leitgeb R, Ma J, Shiyam Sundar LK, Theek B, Mawlawi O (2020) What scans we will read: imaging instrumentation trends in clinical oncology. Cancer Imaging 20:38. https://doi.org/10.1186/s40644-020-00312-3

    Article  Google Scholar 

  12. Razzak MI, Naz S, Zaib A (2018) Deep learning for medical image processing: overview, challenges and the future. In: Dey N, Ashour AS, Borra S (eds) Classification in BioApps. Springer, Cham, pp 323–350. https://doi.org/10.1007/978-3-319-65981-7_12

    Chapter  Google Scholar 

  13. Jiang F, Jiang Y, Zhi H, Dong Y, Li H, Ma S, Wang Y, Dong Q, Shen H, Wang Y (2017) Artificial intelligence in healthcare: past, present and future. Stroke Vasc Neurol 2:230–243. https://doi.org/10.1136/svn-2017-000101

    Article  Google Scholar 

  14. Lundervold AS, Lundervold A (2019) An overview of deep learning in medical imaging focusing on MRI. Z Med Phys 29:102–127. https://doi.org/10.1016/j.zemedi.2018.11.002

    Article  Google Scholar 

  15. Hosny A, Parmar C, Quackenbush J, Schwartz LH, Aerts HJWL (2018) Artificial intelligence in radiology. Nat Rev Cancer 18:500–510. https://doi.org/10.1038/s41568-018-0016-5

    Article  Google Scholar 

  16. Kim Y, Lee JH, Choi S, Lee JM, Kim J-H, Seok J, Joo HJ (2020) Validation of deep learning natural language processing algorithm for keyword extraction from pathology reports in electronic health records. Sci Rep 10:20265. https://doi.org/10.1038/s41598-020-77258-w

    Article  Google Scholar 

  17. Jayachandran A, Dhanasekaran R (2017) Multi class brain tumor classification of MRI images using hybrid structure descriptor and fuzzy logic based RBF kernel SVM. Iran J Fuzzy Syst 14(3):41–54

    MathSciNet  Google Scholar 

  18. Prabhu AJ, Jayachandran A (2018) Mixture model segmentation system for parasagittal meningioma brain tumor classification based on hybrid feature vector. J Med Syst 42(12):1–6

    Google Scholar 

  19. Venketbabu T, Arunkumar BM (2020) Improved convolutional neural networks in content based image retrieval system for medical image analysis. Solid State Technol 63(6):9194–9208

    Google Scholar 

  20. Mishra R, Daescu O, Leavey P, Rakheja D, Sengupta A (2018) Convolutional neural network for histopathological analysis of osteosarcoma. J Comput Biol 25:313–325

    Article  MathSciNet  Google Scholar 

  21. Anisuzzaman DM, Barzekar H, Tong L, Luo J, Yu Z (2021) A deep learning study on osteosarcoma detection from histological images. Biomed Signal Process Control 69:102931. https://doi.org/10.1016/j.bspc.2021.102931

    Article  Google Scholar 

  22. Fu Y, Xue P, Ji H, Cui W, Dong E (2020) Deep model with Siamese network for viable and necrotic tumor regions assessment in osteosarcoma. Med Phys 47:4895–4905. https://doi.org/10.1002/mp.14397

    Article  Google Scholar 

  23. Ho DJ, Agaram NP, Schüffler PJ, Vanderbilt CM, Jean M-H, Hameed MR, Fuchs TJ. Deep interactive learning: an efficient labeling approach for deep learning-based osteosarcoma treatment response assessment. In: Martel AL, Abolmaesumi P, Stoyanov D

  24. Mateus D, Zuluaga MA, Zhou SK, Racoceanu D, Joskowicz L (eds) (2020) Medical image computing and computer assisted intervention—MICCAI 2020. Springer, Cham, pp 540–549. https://doi.org/10.1007/978-3-030-59722-1_52

    Book  Google Scholar 

  25. Li H, Yang F, Zhao Y, Xing X, Zhang J, Gao M, Huang J, Wang L, Yao J (2021) DT-MIL: deformable transformer for multi-instance learning on histopathological image. In: de Bruijne M, Cattin PC, Cotin S, Padoy N, Speidel S, Zheng Y, Essert C (eds) Medical image computing and computer assisted intervention—MICCAI 2021. Springer, Cham, pp 206–216. https://doi.org/10.1007/978-3-030-87237-3_20

    Chapter  Google Scholar 

  26. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3431–3440

  27. Siddique N, Paheding S, Elkin CP, Devabhaktuni V (2021) U-net and its variants for medical image segmentation: a review of theory and applications. IEEE Access 9:82031–82057

    Article  Google Scholar 

  28. Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: Proceedings of the international conference on medical image computing and computer-assisted intervention, pp 234–241

  29. Yang X, Li H, Li X (2022) Lightweight image super-resolution with feature cheap convolution and attention mechanism. Clust Comput 25:3977–3992

    Article  Google Scholar 

  30. Theckedath D, Sedamkar RR (2020) Detecting affect states using VGG16, ResNet50 and SE-ResNet50 networks. SN Comput Sci 1:79. https://doi.org/10.1007/s42979-020-0114-9

    Article  Google Scholar 

  31. Pan L, Pipitsunthonsan P, Daengngam C, Channumsin S, Sreesawet S, Chongcheawchamnan M (2021) Identification of complex mixtures for Raman spectroscopy using a novel scheme based on a new multi-label deep neural network. IEEE Sens J 21:10834–10843

    Article  Google Scholar 

  32. Hu J, Shen L, Albanie S, Sun G, Wu E (2020) Squeeze-and-excitation networks. IEEE Trans Pattern Anal Mach Intell 42:2011–2023

    Article  Google Scholar 

  33. Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O (2016) 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 424–432

  34. Fu J, Liu J, Tian H, Li Y, Bao Y, Fang Z, Lu H (2019) Dual attention network for scene segmentation. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 3141–3149

  35. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. arXiv:1706.03762

  36. Mahiba C, Jayachandran A (2019) Severity analysis of diabetic retinopathy in retinal images using hybrid structure descriptor and modified CNNs. Measurement 135:762–767

    Article  Google Scholar 

  37. Jayachandran A, David DS (2018) Textures and intensity histogram based retinal image classification system using hybrid colour structure descriptor. Biomed Pharmacol J 11(1):577–582

    Article  Google Scholar 

  38. Wang Q, Wu B, Zhu P, Li P, Zuo W, Hu Q (2020) ECA-Net: efficient channel attention for deep convolutional neural networks. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 11531–11539

  39. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhut-dinov R (2014) Dropout: a simple way to prevent neural networks from over- fitting. J Mach Learn Res 15:1929–1958

    MathSciNet  MATH  Google Scholar 

  40. Ghiasi G, Lin T-Y, Le QV (2018) DropBlock: a regularization method for convolutional networks. arXiv:1810.12890

  41. Milletari F, Navab N, Ahmadi S (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: Proceedings-international conference on 3D vision, pp 565–571

  42. Clark K, Vendt B, Smith K, Freymann J, Kirby J et al (2019) The cancer imaging archive (TCIA): maintaining and operating a public information repository. J Digit Imaging 26(6):1045–1057

    Article  Google Scholar 

  43. Wu J, Yang S, Gou F et al (2022) Intelligent segmentation medical assistance system for MRI images of osteosarcoma in developing countries. Comput Math Methods Med 2022:17

    Google Scholar 

  44. Ferreira CA, Melo T, Sousa P, Meyer MI, Shakibapour E, Costa P, Campilho A (2018) Classification of breast cancer histology images through transfer learning using a pre-trained inception Resnet V2. In: Campilho A, Karray F, ter HaarRomeny B (eds) Image analysis and recognition. Springer, Cham, pp 763–770. https://doi.org/10.1007/978-3-319-93000-8_86

    Chapter  Google Scholar 

  45. Chollet F (2017) Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1251–1258

  46. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:14091556

  47. Huang G, Liu Z, Pleiss G, Van Der Maaten L, Weinberger K (2019) Convolutional networks with dense connectivity. IEEE Trans Pattern Anal Mach Intell 44:8704–8716

    Article  Google Scholar 

  48. Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: Thirty-first AAAI conference on artificial intelligence

  49. Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J (2020) UNet: redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans Med Imaging 39:1856–1867

    Article  Google Scholar 

  50. Yang Z, Peng X, Yin Z (2020) Deeplab v3 plus-net for image semantic segmentation with channel compression. In: Proceedings of IEEE 20th international conference on communication technology (ICCT). IEEE, pp 1320–1324

  51. Badrinarayanan V, Kendall A, Cipolla R (2017) SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39:2481–2495

    Article  Google Scholar 

Download references

Acknowledgements

This work was not supported by funding Agencies.

Author information

Authors and Affiliations

  1. Department of CSE, PSN College of Engineering and Technology, Tirunelveli, India

    A. Jayachandran & S. Ratheesh Kumar

  2. Department of CSE, Study World College of Engineering, Coimbatore, India

    S. Ganesh

Authors
  1. A. Jayachandran
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Ganesh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. S. Ratheesh Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. Jayachandran.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jayachandran, A., Ganesh, S. & Kumar, S.R. Multi-stage Deep Convolutional Neural Network for Histopathological Analysis of Osteosarcoma. Neural Comput & Applic 35, 20351–20364 (2023). https://doi.org/10.1007/s00521-023-08837-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-023-08837-x

Keywords

Search

Navigation