Skip to main content
Log in

Image quality assessment based on regions of interest

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Most methods in the literature of image quality assessment (IQA) use whole image information for measuring image quality. However, human perception does not always use this criterion to assess the quality of images. Individuals usually provide their opinions by considering only some parts of an image, called regions of interest. Based on this hypothesis, in this research work, a segmentation technique is initially employed to obtain a bi-level image map composed of the foreground and background information. A patch selection strategy is then proposed to choose some particular patches based on the foreground information as the regions of interest for IQA. Three recent IQA methods in the literature are considered to demonstrate the improvement in IQA when using only the extracted regions of interest. To evaluate the impact of the proposed patch selection strategy in various IQA metrics, three publicly available datasets were used for experiments. Experimental results have revealed that our proposal, based on the regions of interest, can improve quality measures of three IQA methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Abdelouahad, A.A., Hassouni, M.E., Cherifi, H., Aboutajdine, D.: Reduced reference image quality assessment based on statistics in empirical mode decomposition domain. Signal Image Video Process. 8(8), 1663–1680 (2014)

    Article  Google Scholar 

  2. Alaei, A., Pal, U., Nagabhushan, P.: A new scheme for unconstrained handwritten text-line segmentation. Pattern Recognit. 44(4), 917–928 (2011)

    Article  Google Scholar 

  3. Alers, H., Redi, J., Liu, H., Heynderickx, I.: Studying the effect of optimizing image quality in salient regions at the expense of background content. J. Electron. Imaging 22(4), 043012 (2013)

  4. Beghdadia, A., Larabib, M.-C., Bouzerdoumc, A., Iftekharuddind, K.M.: A survey of perceptual image processing methods. Signal Process. Image Commun. 28, 811–831 (2013)

    Article  Google Scholar 

  5. Le Callet, P., Niebur, E.: Visual attention and applications in multimedia technologies. Proc. IEEE 101(9), 2058–2067 (2013)

    Article  Google Scholar 

  6. Chandler, D.M.: Seven challenges in image quality assessment: past, present, and future research. ISRN Signal Process. 2013, 53 (2013)

  7. Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603–619 (2002)

    Article  Google Scholar 

  8. Engelk, U., Le Callet, P.: Perceived interest and overt visual attention in natural images. In: Signal Processing: Image Communication (2015)

  9. Ghanem, B., Resendiz, E., Ahuja, N.: Segmentation-based perceptual image quality assessment (spiqa). In: Proceedings of the International Conference on Image Processing, pp. 393–396 (2008)

  10. Gu, K., Wang, S., Zhai, G., Ma, S., Yang, X., Zhang, W.: Content-weighted mean-squared error for quality assessment of compressed images. Signal Image Video Process. 10(5), 803–810 (2016)

    Article  Google Scholar 

  11. Guo, A., Zhao, D., Liu, S., Fan, X., Gao, W.: Visual attention based image quality assessment. In: Proceedings of the 18th IEEE International Conference on Image Processing, pp. 3297–3300 (2011)

  12. Itti, L., Koch, C.: Computational modelling of visual attention. Nat. Rev. Neurosci. 2(3), 194–203 (2001)

    Article  Google Scholar 

  13. Li, J., Zou, L., Yan, J., Deng, D., Qu, T., Xie, G.: No-reference image quality assessment using prewitt magnitude based on convolutional neural networks. Signal Image Video Process. 10(4), 609–616 (2016)

    Article  Google Scholar 

  14. Liu, H., Engelke, U., Junle, W., Le Callet, P., Heynderickx, I.: How does image content affect the added value of visual attention in objective image quality assessment? IEEE Signal Process. Lett. 20(4), 355–358 (2013)

    Article  Google Scholar 

  15. Liu, H., Wang, J., Redi, J., Le Callet, P., Heynderickx, I.: An efficient no-reference metric for perceived blur. In: Proceedings of the 3rd European Workshop on Visual Information Processing (EUVIP), pp. 174–179 (2011)

  16. Mittal, A., Moorthy, A.K., Bovik, A.C., Cormack, L.K.: Automatic prediction of saliency on jpeg distorted images. In: International Workshop on Quality of Multimedia Experience, pp. 195–200 (2011)

  17. Ninassi, A., Le Meur, O., Le Callet, P., Barbba, D.: Does where you gaze on an image affect your perception of quality? Applying visual attention to image quality metric. In: Proceedings of the 15th IEEE International Conference on Image Processing (ICIP), pp. 169–172 (2007)

  18. Osberger, W., Bergmann, N., Maeder, A.: Automatic image quality assessment technique incorporating higher level perceptual factors. In: Proceedings of the International Conference on Image Processing, volume 3, pp. 414–418 (1998)

  19. Ponomarenko, N., Lukin, V., Zelensky, A., Egiazarian, K., Carli, M., Battisti, F.: TID 2008—a database for evaluation of full-reference visual quality assessment metrics. Adv. Mod. Radioelectron. 10, 30–45 (2009)

    Google Scholar 

  20. Redi, J., Liu, H., Gastaldo, P., Zunino, R., Heynderickx, I.: How to apply spatial saliency into objective metrics for jpeg compressed images? In: Proceedings of the 16th IEEE International Conference on Image Processing (ICIP), pp. 961–964 (2009)

  21. Redi, J., Liu, H., Zunino, R., Heynderickx, I.: Interactions of visual attention and quality perception. In: IS&T/SPIE Electronic, Imaging (2011)

  22. Sheikh, H.R., Wang, Z., Cormack, L., Bovik, A.C.: Live image quality assessment database release 2 (2006)

  23. Tong, Y., Konik, H., Cheikh, F.A., Tremeau, A.: Full reference image quality assessment based on saliency map analysis. J. Imaging Sci. Technol. 54(3), 305031–305034 (2010)

    Article  Google Scholar 

  24. Wang, J., Barkowsky, M., Ricordeland, V., Le Callet, P.: Quantifying how the combination of blur and disparity affects the perceived depth. In: Proceedings of SPIE 7865, Human Vision and Electronic Imaging XVI, California, 2 Feb 2011

  25. Wang, J., Chandler, D.M., Le Callet, P.: Quantifying the relationship between visual salience and visual importance. In: Proceedings of SPIE Human Vision and Electronic Imaging, volume 7527 (2010)

  26. Wang, Z., Bovik, A.C.: Embedded foveation image coding. IEEE Trans. Image Process. 10(10), 1397–1410 (2001)

    Article  MATH  Google Scholar 

  27. Xue, W., Zhang, L., Mou, X.: Learning without human scores for blind image quality assessment. In: IEEE Conference Computer Vision Pattern Recognition (CVPR), pp. 995 – 1002 (2013)

  28. Xue, W., Zhang, L., Mou, X., Bovik, A.C.: Gradient magnitude similarity deviation: a highly efficient perceptual image quality index. IEEE Trans. Image Process. 23(2), 684–695 (2014)

    Article  MathSciNet  Google Scholar 

  29. Zhang, L., Zhang, L., Mou, X., Zhang, D.: FSIM: a feature similarity index for image quality assessment. IEEE Trans. Image Process. 20(8), 2378–2386 (2011)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to A. Alaei.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alaei, A., Raveaux, R. & Conte, D. Image quality assessment based on regions of interest. SIViP 11, 673–680 (2017). https://doi.org/10.1007/s11760-016-1009-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-016-1009-z

Keywords

Navigation