Skip to main content
SpringerLink
Log in

Improved content-based brain tumor retrieval for magnetic resonance images using weight initialization framework with densely connected deep neural network

  • S.I.: Intelligent Systems in Biomedical and Healthcare Informatics
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Content-based medical image retrieval (CBMIR) systems can assist and help doctors and radiologists in reliable diagnosis by retrieving relevant medical cases from past cases that share similarities with the current case. Therefore, there is a need for improved retrieval accuracy in CBMIR systems. Retrieving similar Brain Tumor magnetic resonance imaging (MRI) slices from the same class as the query is inherently challenging. For different types of tumors, there is no class-specific structure, size or shape. Further, MRIs being present in multiple views increase discrepancy in interview retrieval. This leads to high inter-class similarity but at the same time high intra-class variations. Skewed data quantities for Brain Tumor types like Meningioma further add to another challenge. It is necessary to formulate rich and generic MRI representations to address these issues. Toward the same, it is essential to model spatial contexts on a multi-scale across the tumor-affected regions and enhances the feature representational learning by extracting generic features. Hence, we propose a Weight Initialization Framework with Densely Connected Networks to improve generalization for Brain Tumor MRI retrieval. The proposed framework uplifts DenseNet-based models for feature extraction as they incorporate feature reuse and feature learning in a multi-scale manner. Further, a weight Initialization Framework (WIF) is used for improvising the representational learning. Specifically, WIF initializes weights of the DenseNet model by transfer learning-based adaptation, which then involves freezing the initial few layers. The freezing step ensures rich low-level features, even for long-tailed classes like Meningioma, while the remaining trainable layers are fine-tuned to incorporate domain-inherent feature learning. The proposed approach outperforms state-of-the-art by a margin of 1.70% and 1.69% on standard mAP and p@10, respectively. Concretely, when DenseNet and WIF are jointly employed, a stark increment in performance for the Meningioma class is observed, suggesting the generalizability of the framework.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

Data available in a public repository that issues datasets with DOIs.

References

  1. Verma A, Singh VP (2022) Design, analysis and implementation of efficient deep learning frameworks for brain Tumor classification. Multimed Tools Appl 81(26):37541–37567

    Article  Google Scholar 

  2. Gehlot S, Gupta A, Gupta R (2020) SDCT-AuxNet: DCT augmented stain deconvolutional CNN with auxiliary classifier for cancer diagnosis. Med Image Anal 61:101661

    Article  Google Scholar 

  3. Zhang J, Zheng B, Gao A, Feng X, Liang D, Long X (2021) A 3D densely connected convolution neural network with connection-wise attention mechanism for Alzheimer’s disease classification. Magn Reson Imaging 78:119–126

    Article  Google Scholar 

  4. Prashanth R, Roy SD, Mandal PK, Ghosh S (2016) High-accuracy classification of parkinson’s disease through shape analysis and surface fitting in 123I-Ioflupane SPECT imaging. IEEE J Biomed Health Inform 21(3):794–802

    Article  Google Scholar 

  5. Balagurunathan Y, Beers A, Mcnitt-Gray M, Hadjiiski L, Napel S, Goldgof D, Farahani K (2021) Lung nodule malignancy prediction in sequential CT scans: summary of ISBI 2018 challenge. IEEE Trans Med Imaging 40(12):3748–3761

    Article  Google Scholar 

  6. Tyagi A, Singh VP, Gore MM (2023) Towards artificial intelligence in mental health: a comprehensive survey on the detection of schizophrenia. Multimed Tools Appl 82(13):20343–20405

    Article  Google Scholar 

  7. Tyagi A, Singh VP, Gore MM (2023) An efficient automated detection of schizophrenia using k-NN and bag of words features. SN Comput Sci 4(5):518

    Article  Google Scholar 

  8. Ingalhalikar M, Shinde S, Karmarkar A, Rajan A, Rangaprakash D, Deshpande G (2021) Functional connectivity-based prediction of Autism on site harmonized ABIDE dataset. IEEE Trans Biomed Eng 68(12):3628–3637

    Article  Google Scholar 

  9. Qayyum A, Anwar SM, Awais M, Majid M (2017) Medical image retrieval using deep convolutional neural network. Neurocomputing 266:8–20

    Article  Google Scholar 

  10. Fang J, Xu Y, Zhang X, Hu Y, Liu J (2020) Attention-based saliency hashing for ophthalmic image retrieval. In: 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) (pp. 990–995). IEEE.

  11. Wang Z, Lu B, Gao X, Jin Y, Wang Z, Cheung TH, Liu Y (2022) Unsupervised feature disentanglement for video retrieval in minimally invasive surgery. Med Image Anal 75:102296

    Article  Google Scholar 

  12. Kobayashi K, Hataya R, Kurose Y, Miyake M, Takahashi M, Nakagawa A, Hamamoto R (2021) Decomposing normal and abnormal features of medical images for content-based image retrieval of glioma imaging. Med Image Anal 74:102227

    Article  Google Scholar 

  13. Zheng Y, Jiang Z, Shi J, Xie F, Zhang H, Luo W, Xue C (2022) Encoding histopathology whole slide images with location-aware graphs for diagnostically relevant regions retrieval. Med Image Anal 76:102308

    Article  Google Scholar 

  14. Xu L, Zeng X, Zheng B, Li W (2022) Multi-manifold deep discriminative cross-modal hashing for medical image retrieval. IEEE Trans Image Process 31:3371–3385

    Article  Google Scholar 

  15. Öztürk Ş (2020) Stacked auto-encoder based tagging with deep features for content-based medical image retrieval. Expert Syst Appl 161:113693

    Article  Google Scholar 

  16. Cheng J, Yang W, Huang M, Huang W, Jiang J, Zhou Y, Chen W (2016) Retrieval of brain tumors by adaptive spatial pooling and fisher vector representation. PloS One 11(6):e0157112

    Article  Google Scholar 

  17. Swati ZNK, Zhao Q, Kabir M, Ali F, Ali Z, Ahmed S, Lu J (2019) Content-based brain tumor retrieval for MR images using transfer learning. IEEE Access 7:17809–17822

    Article  Google Scholar 

  18. Verma A, Singh VP (2022) HSADML: hyper-sphere angular deep metric based learning for brain tumor classification. In: Mudenagudi U, Nigam A, Sarvadevabhatla RK, Choudhary A (eds) Proceedings of the Satellite Workshops of ICVGIP 2021. Springer Nature Singapore, Singapore, pp 105–120. https://doi.org/10.1007/978-981-19-4136-8_8

    Chapter  Google Scholar 

  19. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556.

  20. Deepak S, Ameer PM (2020) Retrieval of brain MRI with tumor using contrastive loss based similarity on GoogLeNet encodings. Comput Biol Med 125:103993

    Article  Google Scholar 

  21. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 1–9.

  22. Tang Z, Sun ZH, Wu EQ, Wei CF, Ming D, Chen S (2021) MRCG: a MRI retrieval system with convolutional and graph neural networks for secure and private IOMT. IEEE J Biomed Health Inform.

  23. Sun M, Zou W, Hu N, Wang J, Chi Z (2022) Iterative brain tumor retrieval for MR images based on user’s intention model. Pattern Recogn 127:108650

    Article  Google Scholar 

  24. Wang S, Li Z, Yu Y, Xu J (2017) Folding membrane proteins by deep transfer learning. Cell Syst 5(3):202–211

    Article  Google Scholar 

  25. Liu T, Gong M, Lu D, Zhang Q, Zheng H, Jiang F, Zhang M (2021) Building change detection for VHR remote sensing images via local-global pyramid network and cross-task transfer learning strategy. IEEE Trans Geosci Remote Sens 60:1–17

    Google Scholar 

  26. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2818–2826

  27. Matsoukas C, Haslum JF, Sorkhei M, Söderberg M, Smith K (2022) What makes transfer learning work for medical images: feature reuse & other factors. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 9225–9234.

  28. Raghu M, Zhang C, Kleinberg J, Bengio S (2019) Transfusion: understanding transfer learning for medical imaging. Adv Neural Inform Process Syst, 32.

  29. Riasatian A, Babaie M, Maleki D, Kalra S, Valipour M, Hemati S, Tizhoosh HR (2021) Fine-tuning and training of densenet for histopathology image representation using tcga diagnostic slides. Med Image Anal 70:102032

    Article  Google Scholar 

  30. Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708.

  31. Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition, pp 248–255. IEEE.

  32. Cheng J (2017) Brain tumor dataset (Version5). figshare. https://doi.org/10.6084/m9.figshare.1512427.v5

  33. Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: Thirty-first AAAI conference on artificial intelligence.

  34. Chollet F (2017) Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1251–1258.

Download references

Funding

Not applicable.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Motilal Nehru National Institute of Technology Allahabad, Prayagraj, 211004, India

    Vibhav Prakash Singh & Dushyant Kumar Singh

  2. Department of Electronics and Communication Engineering, National Institute of Technology, Raipur, India

    Aman Verma

  3. Amity Centre of Artificial Intelligence, Amity University, Noida, India

    Ritesh Maurya

Authors
  1. Vibhav Prakash Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aman Verma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dushyant Kumar Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ritesh Maurya
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vibhav Prakash Singh.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Ethical approval and Consent to participate

This article does not contain any studies with human participants or animals by any authors.

Human and animal rights

Not applicable.

Consent for publication

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, V.P., Verma, A., Singh, D.K. et al. Improved content-based brain tumor retrieval for magnetic resonance images using weight initialization framework with densely connected deep neural network. Neural Comput & Applic (2023). https://doi.org/10.1007/s00521-023-09149-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00521-023-09149-w

Keywords

Search

Navigation