Skip to main content
SpringerLink
Log in

Medical Image Retrieval System Using Deep Learning Techniques

  • Chapter
  • First Online:
Deep Learning for Biomedical Data Analysis

Abstract

Content-based Image Retrieval (CBIR) system uses the visual information and features present within an image, to find the most analogous images from any gigantic digital image data-set effectively and efficiently, as per the users requirements. Nowadays, the immense advancements in the field of Digital Imaging have exponentially increased the real-time applications of the CBIR techniques. Researchers around the globe are using different CBIR techniques in the field of education, defense, agriculture, remote sensing, satellite imaging, biomedical research, clinical care, and medical imaging. The Major objectives of this chapter are to provide a brief introduction to the different CBIR techniques and their applications on medical image retrieval. This chapter mainly focuses on the current Machine Learning (ML) and Deep Learning (DL) techniques to address the different issues and limitations of the traditional retrieval systems. Initially, we have discussed the different hand-crafted image features based retrieval systems to understand the perspectives of this research field. Here, we aim to congregate the weaknesses and constraints of the conventional retrieval systems and respective solutions with the help of the advanced DL algorithms. Researchers have suggested several CBIR techniques to improve the efficiency of the retrieval of medical images. In this chapter, a review of some state-of-the-art retrieval techniques and respective future research directions are provided.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Jitesh Pradhan, Arup Kumar Pal, and Haider Banka. Principal texture direction based block level image reordering and use of color edge features for application of object based image retrieval. Multimedia Tools and Applications, 78(2):1685–1717, 2019.

    Google Scholar 

  2. Nishant Shrivastava and Vipin Tyagi. Content based image retrieval based on relative locations of multiple regions of interest using selective regions matching. Information Sciences, 259:212–224, 2014.

    Article  Google Scholar 

  3. Jitesh Pradhan, Sumit Kumar, Arup Kumar Pal, and Haider Banka. Texture and color visual features based cbir using 2d dt-cwt and histograms. In International Conference on Mathematics and Computing, pages 84–96. Springer, 2018.

    Google Scholar 

  4. Lin Chen, Dong Xu, Ivor W Tsang, and Jiebo Luo. Tag-based image retrieval improved by augmented features and group-based refinement. IEEE Transactions on Multimedia, 14(4):1057–1067, 2012.

    Google Scholar 

  5. I Ahamd and Taek-Sueng Jang. Old fashion text-based image retrieval using FCA. In Proceedings 2003 International Conference on Image Processing (Cat. No. 03CH37429), volume 3, pages III–33. IEEE, 2003.

    Google Scholar 

  6. Xiang Sean Zhou and Thomas S Huang. Unifying keywords and visual contents in image retrieval. Ieee Multimedia, 9(2):23–33, 2002.

    Google Scholar 

  7. Chen Zhang, Joyce Y Chai, and Rong Jin. User term feedback in interactive text-based image retrieval. In Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, pages 51–58. ACM, 2005.

    Google Scholar 

  8. Wen Li, Lixin Duan, Dong Xu, and Ivor Wai-Hung Tsang. Text-based image retrieval using progressive multi-instance learning. In 2011 International Conference on Computer Vision, pages 2049–2055. IEEE, 2011.

    Google Scholar 

  9. Michael J Swain. Interactive indexing into image databases. In Storage and Retrieval for Image and Video Databases, volume 1908, pages 95–103. International Society for Optics and Photonics, 1993.

    Google Scholar 

  10. Jun Yue, Zhenbo Li, Lu Liu, and Zetian Fu. Content-based image retrieval using color and texture fused features. Mathematical and Computer Modelling, 54(3–4):1121–1127, 2011.

    Article  Google Scholar 

  11. Jitesh Pradhan, Arup Kumar Pal, and Haider Banka. A prominent object region detection based approach for CBIR application. In 2016 Fourth International Conference on Parallel, Distributed and Grid Computing (PDGC), pages 447–452. IEEE, 2016.

    Google Scholar 

  12. Jitesh Pradhan, Ashok Ajad, Arup Kumar Pal, and Haider Banka. Multi-level colored directional motif histograms for content-based image retrieval. The Visual Computer, pages 1–22, 2019.

    Google Scholar 

  13. Safia Abdelmounaime and He Dong-Chen. New brodatz-based image databases for grayscale color and multiband texture analysis. ISRN Machine Vision, 2013, 2013.

    Google Scholar 

  14. Jia Li and James Z Wang. Real-time computerized annotation of pictures. IEEE transactions on pattern analysis and machine intelligence, 30(6):985–1002, 2008.

    Google Scholar 

  15. N Jhanwar, Subhasis Chaudhuri, Guna Seetharaman, and Bertrand Zavidovique. Content based image retrieval using motif cooccurrence matrix. Image and Vision Computing, 22(14):1211–1220, 2004.

    Google Scholar 

  16. Itheri Yahiaoui, Nicolas Hervé, and Nozha Boujemaa. Shape-based image retrieval in botanical collections. In Pacific-Rim Conference on Multimedia, pages 357–364. Springer, 2006.

    Google Scholar 

  17. Manesh Kokare, Prabir K Biswas, and Biswanath N Chatterji. Texture image retrieval using rotated wavelet filters. Pattern recognition letters, 28(10):1240–1249, 2007.

    Google Scholar 

  18. Rui Hu and John Collomosse. A performance evaluation of gradient field hog descriptor for sketch based image retrieval. Computer Vision and Image Understanding, 117(7):790–806, 2013.

    Article  Google Scholar 

  19. Naushad Varish and Arup Kumar Pal. Content based image retrieval using statistical features of color histogram. In 2015 3rd international conference on signal processing, communication and networking (ICSCN), pages 1–6. IEEE, 2015.

    Google Scholar 

  20. Xiang-Yang Wang, Yong-Jian Yu, and Hong-Ying Yang. An effective image retrieval scheme using color, texture and shape features. Computer Standards & Interfaces, 33(1):59–68, 2011.

    Article  CAS  Google Scholar 

  21. B Sathya Bama, S Mohana Valli, S Raju, and V Abhai Kumar. Content based leaf image retrieval (CBLIR) using shape, color and texture features. Indian Journal of Computer Science and Engineering, 2(2):202–211, 2011.

    Google Scholar 

  22. Murala Subrahmanyam, RP Maheshwari, and R Balasubramanian. A correlogram algorithm for image indexing and retrieval using wavelet and rotated wavelet filters. International Journal of Signal and Imaging Systems Engineering, 4(1):27–34, 2011.

    Google Scholar 

  23. Muhammad Sajjad, Amin Ullah, Jamil Ahmad, Naveed Abbas, Seungmin Rho, and Sung Wook Baik. Integrating salient colors with rotational invariant texture features for image representation in retrieval systems. Multimedia Tools and Applications, 77(4):4769–4789, 2018.

    Google Scholar 

  24. Tomasz Andrysiak and Michal Choraś. Image retrieval based on hierarchical gabor filters. International Journal of Applied Mathematics and Computer Science, 15:471–480, 2005.

    Google Scholar 

  25. Nishant Shrivastava and Vipin Tyagi. An efficient technique for retrieval of color images in large databases. Computers & Electrical Engineering, 46:314–327, 2015.

    Article  Google Scholar 

  26. Naushad Varish, Jitesh Pradhan, and Arup Kumar Pal. Image retrieval based on non-uniform bins of color histogram and dual tree complex wavelet transform. Multimedia Tools and Applications, 76(14):15885–15921, 2017.

    Google Scholar 

  27. Muwei Jian, Yilong Yin, Junyu Dong, and Kin-Man Lam. Content-based image retrieval via a hierarchical-local-feature extraction scheme. Multimedia Tools and Applications, 77(21):29099–29117, 2018.

    Article  Google Scholar 

  28. Jitesh Pradhan, Sumit Kumar, Arup Kumar Pal, and Haider Banka. A hierarchical cbir framework using adaptive tetrolet transform and novel histograms from color and shape features. Digital Signal Processing, 82:258–281, 2018.

    Google Scholar 

  29. Jing Li, Nigel Allinson, Dacheng Tao, and Xuelong Li. Multitraining support vector machine for image retrieval. IEEE Transactions on Image Processing, 15(11):3597–3601, 2006.

    Article  Google Scholar 

  30. Yiqing Guo, Xiuping Jia, and David Paull. Effective sequential classifier training for svm-based multitemporal remote sensing image classification. IEEE Transactions on Image Processing, 27(6):3036–3048, 2018.

    Article  Google Scholar 

  31. Hossein Pourghassem and Hassan Ghassemian. Content-based medical image classification using a new hierarchical merging scheme. Computerized Medical Imaging and Graphics, 32(8):651–661, 2008.

    Article  Google Scholar 

  32. Xiao-Feng Wang, De-Shuang Huang, Ji-Xiang Du, Huan Xu, and Laurent Heutte. Classification of plant leaf images with complicated background. Applied mathematics and computation, 205(2):916–926, 2008.

    Article  Google Scholar 

  33. Kunshan Huang, Shutao Li, Xudong Kang, and Leyuan Fang. Spectral–spatial hyperspectral image classification based on knn. Sensing and Imaging, 17(1):1, 2016.

    Google Scholar 

  34. Andy Liaw, Matthew Wiener, et al. Classification and regression by randomforest. R news, 2(3):18–22, 2002.

    Google Scholar 

  35. Johan AK Suykens and Joos Vandewalle. Least squares support vector machine classifiers. Neural processing letters, 9(3):293–300, 1999.

    Google Scholar 

  36. S Rasoul Safavian and David Landgrebe. A survey of decision tree classifier methodology. IEEE transactions on systems, man, and cybernetics, 21(3):660–674, 1991.

    Google Scholar 

  37. Sankar K Pal and Sushmita Mitra. Multilayer perceptron, fuzzy sets, and classification. IEEE Transactions on neural networks, 3(5):683–697, 1992.

    Google Scholar 

  38. Karen Simonyan and Andrew Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.

    Google Scholar 

  39. Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, and Zbigniew Wojna. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2818–2826, 2016.

    Google Scholar 

  40. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097–1105, 2012.

    Google Scholar 

  41. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778, 2016.

    Google Scholar 

  42. Fabio Alexandre Spanhol, Luiz S Oliveira, Caroline Petitjean, and Laurent Heutte. Breast cancer histopathological image classification using convolutional neural networks. In 2016 international joint conference on neural networks (IJCNN), pages 2560–2567. IEEE, 2016.

    Google Scholar 

  43. Emmanuel Maggiori, Yuliya Tarabalka, Guillaume Charpiat, and Pierre Alliez. Convolutional neural networks for large-scale remote-sensing image classification. IEEE Transactions on Geoscience and Remote Sensing, 55(2):645–657, 2016.

    Article  Google Scholar 

  44. Ali Madani, Mehdi Moradi, and Tanveer F Syeda-Mahmood. Medical image classification based on a generative adversarial network trained discriminator, June 27 2019. US Patent App. 15/850,116.

    Google Scholar 

  45. ME Paoletti, JM Haut, J Plaza, and A Plaza. A new deep convolutional neural network for fast hyperspectral image classification. ISPRS journal of photogrammetry and remote sensing, 145:120–147, 2018.

    Article  Google Scholar 

  46. Jianpeng Zhang, Yutong Xie, Qi Wu, and Yong Xia. Medical image classification using synergic deep learning. Medical image analysis, 54:10–19, 2019.

    Article  Google Scholar 

  47. Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke, and Alexander A Alemi. Inception-v4, inception-resnet and the impact of residual connections on learning. In Thirty-First AAAI Conference on Artificial Intelligence, 2017.

    Google Scholar 

  48. Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, pages 248–255. Ieee, 2009.

    Google Scholar 

  49. Alex Alemi. Improving inception and image classification in tensorflow. Google Research Blog, 2016.

    Google Scholar 

  50. Noel Codella, Veronica Rotemberg, Philipp Tschandl, M Emre Celebi, Stephen Dusza, David Gutman, Brian Helba, Aadi Kalloo, Konstantinos Liopyris, Michael Marchetti, et al. Skin lesion analysis toward melanoma detection 2018: A challenge hosted by the international skin imaging collaboration (isic). arXiv preprint arXiv:1902.03368, 2019.

    Google Scholar 

  51. Philipp Tschandl, Cliff Rosendahl, and Harald Kittler. The ham10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Scientific data, 5:180161, 2018.

    Article  Google Scholar 

  52. Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.

    Google Scholar 

  53. Christian Igel and Michael Hüsken. Improving the rprop learning algorithm. In Proceedings of the second international ICSC symposium on neural computation (NC 2000), volume 2000, pages 115–121. Citeseer, 2000.

    Google Scholar 

  54. Léon Bottou. Large-scale machine learning with stochastic gradient descent. In Proceedings of COMPSTAT’2010, pages 177–186. Springer, 2010.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Indian Institute of Technology (ISM), Dhanbad, India

    Jitesh Pradhan, Arup Kumar Pal & Haider Banka

Authors
  1. Jitesh Pradhan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Arup Kumar Pal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Haider Banka
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Computing and Information Technology, The University of Bisha, Bisha, Saudi Arabia

    Mourad Elloumi

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Pradhan, J., Pal, A.K., Banka, H. (2021). Medical Image Retrieval System Using Deep Learning Techniques. In: Elloumi, M. (eds) Deep Learning for Biomedical Data Analysis. Springer, Cham. https://doi.org/10.1007/978-3-030-71676-9_5

Download citation

Publish with us

Policies and ethics

Search

Navigation