Skip to main content
SpringerLink
Log in

Deep features based medical image retrieval

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, deep convolutional neural network model is developed for classification and image retrieval purpose. Deep learning techniques obtained deep features from different abstraction levels represented using multiple hidden layers. This ultimately improves retrieval performance. We developed a framework based on multilayered convolutional neural network to represent medical images as deep features which are used for retrieval purpose. The proposed network’s architecture is similar to Alexnet. The extracted deep features are used to calculate similarity index between the images using distance measures and based on similarity index, retrieval is done. By using a data augmentation technique the model achieved better retrieval accuracy. The model is evaluated on different medical databases using evaluation criteria like average retrieval precision and average retrieval recall and results are compared with the state of the art image retrieval techniques. From comparison retrieval results are significantly improved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Alzubi A, Amira A, Ramzan N (2017) Content-based image retrieval with compact deep convolutional features. Neurocomputing 249:95–105

    Article  Google Scholar 

  2. Baby C, Chandy D (2013) Content based retinal image retrieval using dual tree complex wavelet transform. IEEE Int Conf SIPR:4673–4862

  3. Bai C, Huang L, Pan X, Zheng J, Chen S (2018) Optimization of deep convolutional neural network for large scale image retrieval. Neurocomputing 303:60–67

    Article  Google Scholar 

  4. Dubey S, Singh S, Singh R (2016) Local bit-plane decoded pattern: a novel feature descriptor for biomedical image retrieval. IEEE J Biomed and health Inf 20:2168–2194

    Google Scholar 

  5. Galshetwar GM, Waghmare LM, Gonde AB, Murala S (2017) Edgy salient local binary patterns in inter-plane relationship for image retrieval in diabetic retinopathy. Procedia Comput Sci 115:440–447

    Article  Google Scholar 

  6. Gao Z, Zhang J, Zhou L, Wang L (2014) “HEp-2 cell image classification with convolutional neural networks”. 1st Workshop Patt Recogn Techn Indirect Immun Images

  7. Guo Z, Zhang L, Zhang D (2010) Rotation invariant texture classification using LBP variance with global matching. Pattern Recogn 43:706–716

    Article  Google Scholar 

  8. Han D, Liu Q, Fan W (2018) A new image classification method using CNN transfer learning and web data augmentation. Expert Syst Appl 95:43–56

    Article  Google Scholar 

  9. Kuruvilla J, Gunavathi K (2014) Lung cancer classification using neural networks for CT images. Comp Method Prog Medic 113:202–209

    Google Scholar 

  10. Liao S, Law MWK, Chung ACS (2009) Dominant local binary patterns for texture classification. IEEE Trans. Image Process 18(5):1107–1118

    Article  MathSciNet  Google Scholar 

  11. Liu H, Li B, Lv X, Huang Y (2017) Image retrieval using fused deep convolutional features. Int Congress Inform Comm Technol 107:749–754

    Google Scholar 

  12. Marcus DS, Wang TH, Parker J, Csernansky JG, Morris JC, Buckner RL (2007) Open access series of imaging studies (OASIS): cross-sectional MRI data in young, middle aged, non-demented, and demented older adults. J Cogn Neurosci 19(9):1498–1507

    Article  Google Scholar 

  13. Meiru M (2011) Qiuqi Ruan, song Guo, “shift and gray scale invariant features for palmprint identification using complex directional wavelet and local binary pattern”. Neurocomputing 74:3351–3360

    Article  Google Scholar 

  14. Mohite N, Waghmare L, Gonde A (2019) S Vipparthi, “3D local circular difference patterns for biomedical image retrieval”. Int J Multimedia Inform Retri:8115–8125

  15. Murala S, Wu QMJ (2014) MRI and CT image indexing and retrieval using local mesh peak valley edge patterns. Signal Process Image Commun 29(3):400–409

    Article  Google Scholar 

  16. Murala S (2015) QMJ Wu, “spherical symmetric 3D local ternary patterns for natural, texture and biomedical image indexing and retrieval”. Neurocomputing 149:1502–1514

    Article  Google Scholar 

  17. Murala S, QMJ W (2013) Local ternary co-occurrence patterns: a new feature descriptor for MRI and CT image retrieval. Neurocomputing 119:399–412

    Article  Google Scholar 

  18. Murala S, QMJ W (2014) Local Mesh Patterns Versus Local Binary Patterns: Biomedical Image Indexing and Retrieval. IEEE J Biomed Health Inform 18(3)

  19. Murala S, Maheshwari RP, Balasubramanian R (2012) Directional binary wavelet patterns for biomedical image indexing and retrieval. J Med Syst 36(5):2865–2879

    Article  Google Scholar 

  20. Ojala T, Pietikainen M, Harwood D (1996) A comparative study of texture measures with classification based on feature distributions. Pattern Recogn 29:51–59

    Article  Google Scholar 

  21. Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    Article  Google Scholar 

  22. [Online]. Available: http://messidor.crihan.fr/index-en.php. (n.d.)

  23. Pang S, Orgun MA, Yu Z (2018) A novel biomedical image indexing and retrieval system via deep preference learning. Comput Methods Prog Biomed 158:53–69

    Article  Google Scholar 

  24. Qayyum A, Anwar S, Awais M, Majid M (2017) Medical image retrieval using deep convolutional neural network. Neurocomputing 266:8–20

    Article  Google Scholar 

  25. Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117

    Article  Google Scholar 

  26. Senechal T, Rapp V, Salam H, Seguier R, Bailly K, Prevost L (2012) Facial action recognition combining heterogeneous features via multikernel learning. IEEE Trans. Syst. Man Cybern. B: Cybern. 42(4):993–1005

    Article  Google Scholar 

  27. Shinde A, Rahulkar C (2017) Patil, “fast discrete curvelet transform based anisotropic feature extraction for biomedical image indexing and retrieval”. Int J Multimed Info Retr 6:281–288

    Article  Google Scholar 

  28. Tan X, Triggss B (2010) Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans Image Process 19(6):1635–1650

    Article  MathSciNet  Google Scholar 

  29. Tzelepi M, Tefas A (2018) Deep convolutional learning for content based image retrieval. Neurocomputing 275:2467–2478

    Article  Google Scholar 

  30. VIA/I-ELCAP CT Lung Image Dataset, Available from [Online]:http://www.via.cornell.edu/databases−/lungdb.html.(n.d.)

  31. Vipparthi SK, Nagar S (2014) Expert image retrieval system using directional local motif xor patterns. Expert Syst Appl 41(17):8016–8026

    Article  Google Scholar 

  32. Vipparthi SK, Nagar S (2015) Directional local ternary patterns for multimedia image indexing and retrieval. Int J Signal Imaging Syst Eng, 145 8(3):137

  33. Vipparthi SK, Murala S, Gonde AB, Wu QMJ (2016) Local directional mask maximum edge patterns for image retrieval and face recognition. IET Computer Vision

  34. Vogado L, Veras R, Araujo F, Silva R, Aires K (2018) Leukemia diagnosis in blood slides using transfer learning in CNNs and SVM for classification. Eng Appl Artif Intell 72:415,422

    Article  Google Scholar 

  35. Yang S, Bhanu B (2012) Understanding discrete facial expressions in video using an emotion avatar image. IEEE Trans Syst Man Cybern B: Cybern 42(4):980–992

    Article  Google Scholar 

  36. Yao C-H, Chen S-Y (2003) Retrieval of translated, rotated and scaled color textures. Pattern Recogn 36:913–929

    Article  Google Scholar 

  37. Zhang B, Gao Y, Zhao S, Liu J (2010) Local derivative pattern versus local binary pattern: face recognition with higher-order local pattern descriptor. IEEE Trans Image Process 19(2):533–544

    Article  MathSciNet  Google Scholar 

  38. Zhang M, Zhang K, Feng Q, Wanga J, Kong J, Lu Y (2014) A novel image retrieval method based on hybrid information descriptors. J. Vis. Commun. Image R. 25:1574–1587

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electronics and Telecommunication Engineering, SGGSIET, Nanded, Maharashtra, India

    Nilima B. Mohite & Anil B. Gonde

Authors
  1. Nilima B. Mohite
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anil B. Gonde
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nilima B. Mohite.

Ethics declarations

Conflict of interest

We here all declare no potential conflict of interest. This statement is to certify that all authors have seen and approved the manuscript being submitted. We warrant that the article has not received prior publication and is not under consideration for publication elsewhere.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mohite, N.B., Gonde, A.B. Deep features based medical image retrieval. Multimed Tools Appl 81, 11379–11392 (2022). https://doi.org/10.1007/s11042-022-12085-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12085-x

Keywords

Search

Navigation