Skip to main content

Modelling of Subjective Radiological Assessments with Objective Image Quality Measures of Brain and Body CT Images

  • Conference paper
  • First Online:
Image Analysis and Recognition (ICIAR 2015)

Abstract

In this work we determine how well the common objective image quality measures (Mean Squared Error (MSE), local MSE, Signal-to-Noise Ratio (SNR), Structural Similarity Index (SSIM), Visual Signal-to-Noise Ratio (VSNR) and Visual Information Fidelity (VIF)) predict subjective radiologists’ assessments for brain and body computed tomography (CT) images.

A subjective experiment was designed where radiologists were asked to rate the quality of compressed medical images in a setting similar to clinical. We propose a modified Receiver Operating Characteristic (ROC) analysis method for comparison of the image quality measures where the “ground truth” is considered to be given by subjective scores. The best performance was achieved by the SSIM index and VIF for brain and body CT images. The worst results were observed for VSNR.

We have utilized a logistic curve model which can be used to predict the subjective assessments with an objective criteria. This is a practical tool that can be used to determine the quality of medical images.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Chandler, D.M., Hemami, S.S.: VSNR: A wavelet-based visual signal-to-noise ratio for natural images. IEEE Trans. Image Process. 16(9), 2284–2298 (2007)

    Article  MathSciNet  Google Scholar 

  2. Chandler, D.M., Lim, K.H., Hemami, S.S.: Effects of spatial correlations and global precedence on the visual fidelity of distorted images. In: Human Vision and Electronic Imaging XI, vol. 6057, February 2006

    Google Scholar 

  3. Cosman, P.C., Gray, R.M., Olshen, R.A.: Evaluating quality of compressed medical images: Snr, subjective rating, and diagnostic accuracy. In: 82 (ed.) Proceedings of the IEEE, vol. 6, pp. 919–932, June 1994

    Google Scholar 

  4. Fidler, A., Likar, B.: What is wrong with compression ratio in lossy image compression? Radiology 245(1), 299 (2007)

    Article  Google Scholar 

  5. A. George and S. J. Livingston. A survey on full reference image quality assessment algorithms. IJRET: Int. J. Research Eng. Technol. 2(12), December 2013

    Google Scholar 

  6. Koff, D., Bak, P., Brownrigg, P., Hosseinzadeh, D., Khademi, A., Kiss, A., Lepanto, L., Michalak, T., Shulman, H., Volkening, A.: Pan-canadian evaluation of irreversible compression ratios (lossy compression) for development of national guidelines. J. Digit. Imaging 22(6), 569–578 (2009)

    Article  Google Scholar 

  7. Koff, D., Shulman, H.: An overview of digital compression of medical images: Can we use lossy image compression in radiology? CARJ 57(4), 211–217 (2006)

    Google Scholar 

  8. Kowalik-Urbaniak, I.A.: The quest for ’diagnostically lossless’ medical image compression using objective image quality measures. Ph.D. thesis, University of Waterloo, 200 University Ave W, Waterloo, ON N2L 3G1 (2014)

    Google Scholar 

  9. Kowalik-Urbaniak, I.A., Brunet, D., Wang, J., Vrscay, E., Wang, Z., Koff, D., Koff, N., Wallace, B.: The quest for ’diagnostically lossless’ medical image compression: a comparative study of objective quality metrics for compressed medical images. In: Medical Imaging : Image Perception. Observer Performance, and Technology Assessment 9037, 2014 (2014)

    Google Scholar 

  10. Marmolin, H.: Subjective MSE measures. IEEE Trans. Syst. Man and Cybern., SMC 16(3), 486–489 (1986)

    Article  Google Scholar 

  11. Metz, C.E.: Basic principles of ROC analysis. Semin. Nucl. Med. 8, 282–298 (1978)

    Article  Google Scholar 

  12. Nait-Ali, A., Cavaro-Menard, C.: Compression of Biomedical Images and Signals. Wiley, London (2008)

    Book  Google Scholar 

  13. European Society of Radiology: (ESR). Usability of irreversible image compression in radiological imaging. Insights into. Imaging 2(2), 103–115 (2011)

    Google Scholar 

  14. Sheikh, H.R., Bovik, A.C., de Veciana, S.G.: An information fidelity criterion for image quality assessment using natural scene statistics. IEEE Trans. Image Proces. 14(12), 2117–2128 (2005)

    Article  Google Scholar 

  15. Wang, Z., Bovik, A.C.: Mean squared error: love it or leave it? - a new look at signal fidelity measures. IEEE Signal Proc. Mag. 26(1), 98–117 (2009)

    Article  Google Scholar 

  16. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Proces. 13(4), 600–612 (2004)

    Article  Google Scholar 

  17. Wang, Z., Li, Q.: Information content weighting for perceptual image quality assessment. IEEE Trans. Image Proces. 20(5), 1185–1198 (2011)

    Article  Google Scholar 

Download references

Acknowledgements

We thank Prof. Paul Marriott, Department of Statistics and Actuarial Sciences, University of Waterloo for valuable advice with regard to the statistical design of our experiments. This research was supported in part by Discovery Grants from the Natural Sciences and Engineering Research Council of Canada (ERV and ZW).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ilona A. Kowalik-Urbaniak .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Kowalik-Urbaniak, I.A. et al. (2015). Modelling of Subjective Radiological Assessments with Objective Image Quality Measures of Brain and Body CT Images. In: Kamel, M., Campilho, A. (eds) Image Analysis and Recognition. ICIAR 2015. Lecture Notes in Computer Science(), vol 9164. Springer, Cham. https://doi.org/10.1007/978-3-319-20801-5_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-20801-5_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-20800-8

  • Online ISBN: 978-3-319-20801-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics