Skip to main content

Abstract

The rapid increase in medical images makes it more difficult and time-consuming to find relevant images when they are needed. This opens an opportunity to develop technological solutions to solve this problem and help the medical field. This paper proposes a solution for content-based medical image retrieval using a pre-trained deep convolutional neural network. In this work, the Inception V3 model was used with ImageNet weights modifying the last layer to fit the data used. These comprise an open dataset with six classes. The model has been optimized using regularization techniques to obtain 99.98% accuracy in the classification stage and 99% accuracy in the image retrieval stage.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Deserno, T.M.: Biomedical Image Processing. Aachen, Germany. Springer, Berlin, Heidelberg (2011)

    Google Scholar 

  2. Cai, W., Kim, J., Feng, D.D.: Biomedical Information Technology. Academic Press Inc., San Diego (2007)

    Google Scholar 

  3. Srinivas, M., Naidu, R.R., Sastry, C.S., Mohan, C.K.: Content based medical image retrieval using dictionary learning. Neurocomputing 168, 880–895 (2015). ISSN 0925-2312. https://doi.org/10.1016/j.neucom.2015.05.036

  4. Dhingra, S., Bansal, P.: Experimental analogy of different texture feature extraction techniques in image retrieval systems. Multimed. Tools Appl. 79, 27391–27406 (2020). https://doi.org/10.1007/s11042-020-09317-3

  5. Ahmed, K.W., Al Aziz, M.M., Sadat, M.N., Alhadidi, D., Mohammed, N.: Nearest neighbour search over encrypted data using intel SGX. J. Inform. Secur. Appl. 54, 102579 (2020). ISSN 2214-2126. https://doi.org/10.1016/j.jisa.2020.102579

  6. Müller, H.: Medical image retrieval: applications and resources. In: Proceedings of the 2020 International Conference on Multimedia Retrieval (ICMR’20). Association for Computing Machinery, New York, NY, USA, pp. 2–3 (2020). https://doi.org/10.1145/3372278.3390668

  7. Ma, L., Liu, X., Gao, Y., Zhao, Y., Zhao, X., Zhou, C.: A new method of content based medical image retrieval and its applications to CT imaging sign retrieval. J. Biomed. Inform. 66, 148–158. (2017). ISSN 1532-0464. https://doi.org/10.1016/j.jbi.2017.01.002

  8. Shamna, P., Govindan, V.K., Nazeer, K.A.A.: Content based medical image retrieval using topic and location model. J. Biomed. Inf. 91, 103112 (2019). ISSN 1532-0464. https://doi.org/10.1016/j.jbi.2019.103112

  9. Wei, C.-H., Li, C.-T., Wilson, R.: A general framework for content-based medical image retrieval with its application to mammograms. In: Proceedings of the SPIE 5748, Medical Imaging 2005: PACS and Imaging Informatics, 15 Apr 2005. https://doi.org/10.1117/12.594929

  10. Park, S.C., Sukthankar, R., Mummert, L., Satyanarayanan, M., Zheng, B.: Optimization of reference library used in content-based medical image retrieval scheme. Med. Phys. 34(11), 4331–4339 (2007). https://doi.org/10.1118/1.2795826

  11. Haripriya, P., Porkodi, R.: Parallel deep convolutional neural network for content based medical image retrieval. J. Ambient Intell. Human Comput. 12, 781–795 (2021). https://doi.org/10.1007/s12652-020-02077-w

  12. Chung, Y.-A., Weng, W.-H.: Learning Deep Representations of Medical Images Using Siamese CNNs with Application to Content-Based Image Retrieval, arXiv:1711.08490 (2017)

  13. Khatami, A., Babaie, M., Tizhoosh, H.R., Khosravi, A., Nguyen, T., Nahavandi, S.: A sequential search-space shrinking using CNN transfer learning and a Radon projection pool for medical image retrieval. Exp. Syst. Appl. 100, 224–233 (2018). ISSN 0957-4174. https://doi.org/10.1016/j.eswa.2018.01.056

  14. Owais, M., Arsalan, M., Choi, J., Park, K.R.: Effective Diagnosis and Treatment through Content-Based Medical Image Retrieval (CBMIR) by Using Artificial Intelligence. Journal of Clinical Medicine. 8(4), 462 (2019). https://doi.org/10.3390/jcm8040462

  15. Roth, H.R., Lee, C.T., Shin, H.-C., Seff, A., Kim, L., Yao, J., Lu, L., Summers, R.M., Anatomy-specific classification of medical images using deep convolutional nets. In: 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI). IEEE, 2015. ISSN 9781479923748. https://doi.org/10.1109/ISBI.2015.7163826

  16. Judah, E.S., Sklan, A.J. Plassard, D.F., Landman, B.A.: Toward content-based image retrieval with deep convolutional neural networks. In: Proceedings of the SPIE 9417, Medical Imaging 2015: Biomedical Applications in Molecular, Structural, and Functional Imaging, 94172C, 19 Mar 2015. https://doi.org/10.1117/12.2081551

  17. Qayyum, A., Anwar, S.M., Awais, M., Majid, M.: Medical image retrieval using deep convolutional neural network. Neurocomputing 266, 8–20 (2017). ISSN 0925-2312. https://doi.org/10.1016/j.neucom.2017.05.025

  18. Öztürk, Ş.: Stacked auto-encoder based tagging with deep features for content-based medical image retrieval. Exp. Syst. Appl. 161, 113693 (2020). ISSN 0957-4174. https://doi.org/10.1016/j.eswa.2020.113693

  19. Apolanco3225: Medical MNIST classification. GitHub repository 2017. Available: https://github.com/apolanco3225/Medical-MNIST-Classification

  20. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. arXiv:1512.00567 (2015)

  21. Kingma, D.P., Ba, J.: Adam: A Method for Stochastic Optimization. CoRR abs/1412.6980: n. pag (2015)

    Google Scholar 

  22. Chollet, F., et al.: Keras [Online]. Available: https://keras.io (2015)

  23. Zhang, F., Song, Y., Cai, W., Hauptmann, A.G., Liu, S., Pujol, S., Kikinis, R., Fulham, M.J., Feng, D.D., Chen, M.: Dictionary pruning with visual word significance for medical image retrieval. Neurocomputing 177, 75–88 (2016). ISSN 0925-2312. https://doi.org/10.1016/j.neucom.2015.11.008

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ashwath Rao, B., Kini, G.N., Nostas, J. (2022). Content-Based Medical Image Retrieval Using Pretrained Inception V3 Model. In: Dua, M., Jain, A.K., Yadav, A., Kumar, N., Siarry, P. (eds) Proceedings of the International Conference on Paradigms of Communication, Computing and Data Sciences. Algorithms for Intelligent Systems. Springer, Singapore. https://doi.org/10.1007/978-981-16-5747-4_55

Download citation

Publish with us

Policies and ethics