Skip to main content

Advertisement

SpringerLink
Log in

Survey of information theory in visual quality assessment

  • REVIEW
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

We survey information theoretic approaches to solve a variety of visual quality assessment (QA) problems. These approaches are generally built on natural scene statistical models and lead to practical automatic QA algorithms delivering excellent performance in terms of correlation with human judgments of quality. We study all three categories of image QA models: full reference (FR), reduced reference (RR) and no reference (NR) image QA, as well as FR video QA and information weighting strategies for FR image and video QA. We demonstrate the application of information theory in each of these problems. Each of these problems presents its own challenges in the design of information theoretic QA indices leading to different algorithms under different scenarios. In the algorithms, we survey, FR image and video QA algorithms are based on mutual information or conditional Kolmogorov complexities; RR image QA algorithms either use relative entropy or entropic differences, while the NR QA algorithm applies Rényi entropy, and the weighting strategies rely on mutual information. We also discuss various open research questions, particularly in the realm of NR image QA and all classes of video QA.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. We use the term “natural images” as it is ordinarily used by vision scientists, meaning images (or videos, or 3D) taken by ordinary optical cameras sensitive to visible light.

References

  1. Mannos, J.L., Sakrison, D.J.: The effects of visual fidelity criterion on the encoding of images. IEEE Trans. Inf. Theory 4, 525–536 (1974)

    Article  Google Scholar 

  2. Heeger, D.J., Teo, P.C.: A model of perceptual image fidelity. In: Proceedings of the IEEE International Conference on Image Processing, pp. 343–345 (1995)

  3. Eskicioglu, A.M., Fisher, P.S.: Image quality measures and their performance. IEEE Trans. Commun. 43, 2959–2965 (1995)

    Article  Google Scholar 

  4. Barrett, H.H.: Objective assessment of image quality: effects of quantum noise and object variability. J. Opt. Soc. Am. A 7(7), 1266–1278 (1990)

    Article  Google Scholar 

  5. Barrett, H.H., Denny, J.L., Wagner, R.F., Myers, K.J.: Objective assessment of image quality. II. Fisher information, Fourier crosstalk, and figures of merit for task performance. J. Opt. Soc. Am. A 12, 834–852 (1995)

    Article  Google Scholar 

  6. Barrett, H.H., Abbey, C.K., Clarkson, E.: Objective assessment of image quality III: ROC metrics, ideal observers, and likelihood-generating. J. Opt. Soc. Am. A 15(12), 1520–1535 (1998)

    Article  Google Scholar 

  7. Wang, Z., Bovik, A.C.: Mean squared error: love it or leave it? A new look at signal fidelity measures. IEEE Signal Processing Magazine 26(1), 98–117 (2009)

    Article  Google Scholar 

  8. Wang, Z., Bovik, A.C.: Reduced- and no-reference image quality assessment. The natural scene statistic model approach. Special Issue on Multimedia Quality Assessment, IEEE Signal Processing Magazine (2011)

  9. Sheikh, H.R., Bovik, A.C., de Veciana, G.: An information fidelity criterion for image quality assessment using natural scene statistics. IEEE Trans. Image Process. 14(12), 2117–2128 (2005)

    Article  Google Scholar 

  10. Sheikh, H.R., Bovik, A.C.: Image information and visual quality. IEEE Trans. Image Process. 15(2), 430–444 (2006)

    Article  Google Scholar 

  11. Wang, Z., Li, Q.: Information content weighting for perceptual image quality assessment. IEEE Trans. Image Process. 20(5), 1185–1198 (2011)

    Article  MathSciNet  Google Scholar 

  12. Haijun, Z., Huayi, W.: New paradigm for compressed image quality metric: exporing band similarity with CSF and mutual information. In: Proceedings of IEEE International Geoscience and Remote Sensing Symposium (2005)

  13. Nikwand, N., Wang, Z.: Generic image similarity based on Kolmogorov complexity. In: Proceedings of IEEE International Conference on Image Processing, Hong Kong, China (2010)

  14. Wang, Z., Wu, G., Sheikh, H.R., Simoncelli, E.P., Yang, E.H., Bovik, A.C.: Quality-aware images. IEEE Trans. Image Process. 15(5), 1680–1689 (Jun. 2006)

    Google Scholar 

  15. Li, Q., Wang, Z.: Reduced-reference image quality assessment using divisive normalization-based image representation. IEEE J. Sel. Top. Signal Process. Special issue on Visual Media Quality Assessment 3, 202–211 (2009)

    Article  Google Scholar 

  16. Soundararajan, R., Bovik, A.C.: RRED indices: reduced reference entropic differencing for image quality assessment. IEEE Trans. Image Process. 21(2), 517–526 (2012)

    Article  MathSciNet  Google Scholar 

  17. Gabarda, S., Cristobal, G.: Blind image quality assessment through anisotropy. J. Opt. Soc. Am. A 24, B42–B51 (2007)

    Article  Google Scholar 

  18. Sheikh H.R., Bovik, A.C.: A visual information fidelity approach to video quality assessment. In: Proceedings of 1st International Workshop on Video Processing and Quality Metrics for Consumer Electronics, Scottsdale, AZ (2005)

  19. Seshadrinathan, K., Bovik, A.C.: An information theoretic video quality metric based on motion models. In: Proceedings of 3rd International Workshop on Video Processing and Quality Metrics for Consumer Electronics, Scottsdale, Arizona (2007)

  20. Seshadrinathan, K., Bovik, A.C.: Motion-tuned spatio-temporal quality assessment of natural videos. IEEE Trans. Image Process. 19, 335–350 (2010)

    Article  MathSciNet  Google Scholar 

  21. Wang, Z., Li, Q.: Video quality assessment using a statistical model of human visual speed perception. J. Opt. Soc. Am. A (Optics, Image Science and Vision) 24(12), B61–B69 (2007)

    Google Scholar 

  22. Portilla, J., Strela, V., Wainwright, M.J., Simoncelli, E.P.: Image denoising using scale mixture of Gaussians in the wavelet domain. IEEE Trans. Image Process. 12(11), 1338–1351 (2003)

    Google Scholar 

  23. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error measurement to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  Google Scholar 

  24. Li, M., Chen, X., Li, X., Ma, B., Vitányi, P.M.B.: The similarity metric. IEEE Trans. Inf. Theory 50, 3250–3264 (2004)

    Article  Google Scholar 

  25. Watson, A.B., Kreslake, L.: Measurement of visual impairment scales for digital video. In: Proceedings of SPIE 4299 (2011)

  26. Sheikh, H.R., Wang, Z., Cormack, L., Bovik, A.C.: Live image quality assessment database release 2. Available at http://live.ece.utexas.edu/research/quality

  27. Wang, Z., Simoncelli, E.P., Bovik, A.C.: Multiscale structural similarity for image quality assessment. In: Proceedings of 37th Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA (2003)

  28. Seshadrinathan, K., Bovik A.C.: Unifying analysis of full reference image quality assessment. In: Proceedings of IEEE International Conference on Image Processing, San Diego, CA (2008)

  29. Moorthy, A.K., Bovik, A.C.: A two-step framework for constructing blind image quality indices. IEEE Signal Process. Lett. 17(5), 587–599 (2010)

    Article  Google Scholar 

  30. Saad, M.A., Bovik, A.C., Charrier, C.: A DCT statistics based blind image quality index. IEEE Signal Process. Lett. 17(6), 583–586 (2010)

    Article  Google Scholar 

  31. Moorthy, A.K., Bovik, A.C.: Blind image quality assessment: from scene statistics to perceptual quality. IEEE Trans. Image Process. 20(12), 3350–3364 (2011)

    Google Scholar 

  32. Saad, M.A., Bovik, A.C.: Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans. Image Process. 21, 3339–3352 (2012)

    Google Scholar 

  33. Liu, J., Moulin, P.: Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients. IEEE Trans. Image Process. 10, 1647–1658 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  34. Final report from the video quality experts group on the validation of objective quality metrics for video quality assessment. Available at http://www.its.bldrdoc.gov/vqeg/projects/frtv_phase1

  35. Seshadrinathan, K., Soundararajan, R., Bovik, A.C., Cormack, L.K.: Study of subjective and objective quality assessment of video. IEEE Trans. Image Process. 19, 1427–1441 (2010)

    Article  MathSciNet  Google Scholar 

  36. Moorthy, A.K., Bovik, A.C.: Visual importance pooling for image quality assessment. IEEE J. Sel. Top. Signal Process. 3, 193–201 (2009)

    Article  Google Scholar 

  37. Stocker, A.A., Simoncelli, E.P.: Noise characteristics and prior expectations in human visual speed perception. Nat. Neurosci. 9(4), 578–585 (2006)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of ECE, The University of Texas at Austin, Austin, TX, 78712, USA

    Rajiv Soundararajan & Alan C. Bovik

Authors
  1. Rajiv Soundararajan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alan C. Bovik
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rajiv Soundararajan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Soundararajan, R., Bovik, A.C. Survey of information theory in visual quality assessment. SIViP 7, 391–401 (2013). https://doi.org/10.1007/s11760-013-0442-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-013-0442-5

Keywords

Search

Navigation