Skip to main content

Stacked Autoencoders for Medical Image Search

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10072))

Abstract

Medical images can be a valuable resource for reliable information to support medical diagnosis. However, the large volume of medical images makes it challenging to retrieve relevant information given a particular scenario. To solve this challenge, content-based image retrieval (CBIR) attempts to characterize images (or image regions) with invariant content information in order to facilitate image search. This work presents a feature extraction technique for medical images using stacked autoencoders, which encode images to binary vectors. The technique is applied to the IRMA dataset, a collection of 14,410 x-ray images in order to demonstrate the ability of autoencoders to retrieve similar x-rays given test queries. Using IRMA dataset as a benchmark, it was found that stacked autoencoders gave excellent results with a retrieval error of 376 for 1,733 test images with a compression of 74.61%.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Akgül, C.B., Rubin, D.L., Napel, S., Beaulieu, C.F., Greenspan, H., Acar, B.: Content-based image retrieval in radiology: current status and future directions. J. Digit. Imaging 24(2), 208–222 (2010)

    Article  Google Scholar 

  2. Canadian Medical Protective Association: 2014 annual report of the Canadian medical protective association

    Google Scholar 

  3. Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I.J., Bergeron, A., Bouchard, N., Bengio, Y.: Theano: new features and speed improvements (2012)

    Google Scholar 

  4. Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., Warde-Farley, D., Bengio, Y.: Theano: a CPU and GPU math expression compiler. In: Proceedings of the Python for Scientific Computing Conference (SciPy) (2010)

    Google Scholar 

  5. Camlica, H.R.Z., Tizhoosh, F.K.: Autoencoding the retrieval relevance of medical images. In: The Fifth International Conference on Image Processing Theory, Tools and Applications (IPTA) (2015)

    Google Scholar 

  6. Chan, Y.K., Chen, C.Y.: Image retrieval system based on color complexity and color spatial features. J. Syst. Softw. 71(1), 65–70 (2004)

    Article  MathSciNet  Google Scholar 

  7. Enser, P.G.B.: Content-based image retrieval. Technical report, JTAP-039, ISC Technology Application Program (2000)

    Google Scholar 

  8. Kundel, H.L., Nodine, C.F., Carmody, D.: Visual scanning, pattern recognition and decision-making in pulmonary nodule detection. Invest. Radiol. 13(3), 175–181 (1978)

    Article  Google Scholar 

  9. Idiap Research Institute: Error evaluation for ImageCLEF 2009 IRMA medical image annotation, December 2015

    Google Scholar 

  10. Joshi, M.D., Deshmukh, R.M., Hemke, K.N., Bhake, A., Wajgi, R.: Pictorial information retrieval. J. Doc. 51(2), 126–170 (1995)

    Article  Google Scholar 

  11. Kinsey, T.V., Horton, M.C., Lewis, T.E.: Interfacing the PACS and the HIS: results of a 5-year implementation. RSNA RadioGraphics

    Google Scholar 

  12. Lehmann, T.M., Deselaers, T., Schubert, H., Guld, M.O., Thies, C., Fischer, B., Spitzer, K.: The IRMA code for unique classification of medical images. In: SPIE Proceedings, vol. 5033, pp. 440–451. SPIE (2003)

    Google Scholar 

  13. Lehmann, T.M., Deselaers, T., Schubert, H., Guld, M.O., Thies, C., Fischer, B., Spitzer, K.: IRMA - a content-based approach to image retrieval in medical applications. IRMA Int. Conf. 5033, 911–912 (2006)

    Google Scholar 

  14. Mueller, H., Clough, P., Deselares, T., Caputo, B.: ImageCLEF - Experimental Evaluation in Visual Information Retrieval. Springer, Heidelberg (2010)

    MATH  Google Scholar 

  15. Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning internal representations by error propagation. Parallel Distributed Processing, vol. 1 (1986)

    Google Scholar 

  16. Sumanyu, S.: Source code for “stacked autoencoders” (2016). https://github.com/sumanyu/stacked-denoising-autoencoders

  17. Tan, C.C., Eswaran, C.: Using autoencoders for mammogram compression. Syst. 35(1), 49–58 (2011)

    Google Scholar 

  18. Velmurugan, K., Baboo, S.: Content-based image retrieval using surf and colour moments. Global J. Comput. Sci. Technol. 11(10) (2011). ISSN: 0975-4172, Print ISSN: 0975-4350

    Google Scholar 

  19. Vincent, P., Larochelle, H., Bengio, Y., Manzagol, P.A.: Extracting and composing robust features with denoising autoencoders. In: International Conference on Machine Learning (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to H. R. Tizhoosh .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Sharma, S., Umar, I., Ospina, L., Wong, D., Tizhoosh, H.R. (2016). Stacked Autoencoders for Medical Image Search. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2016. Lecture Notes in Computer Science(), vol 10072. Springer, Cham. https://doi.org/10.1007/978-3-319-50835-1_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-50835-1_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-50834-4

  • Online ISBN: 978-3-319-50835-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics