Abstract
Most methods in the literature of image quality assessment (IQA) use whole image information for measuring image quality. However, human perception does not always use this criterion to assess the quality of images. Individuals usually provide their opinions by considering only some parts of an image, called regions of interest. Based on this hypothesis, in this research work, a segmentation technique is initially employed to obtain a bi-level image map composed of the foreground and background information. A patch selection strategy is then proposed to choose some particular patches based on the foreground information as the regions of interest for IQA. Three recent IQA methods in the literature are considered to demonstrate the improvement in IQA when using only the extracted regions of interest. To evaluate the impact of the proposed patch selection strategy in various IQA metrics, three publicly available datasets were used for experiments. Experimental results have revealed that our proposal, based on the regions of interest, can improve quality measures of three IQA methods.
Similar content being viewed by others
References
Abdelouahad, A.A., Hassouni, M.E., Cherifi, H., Aboutajdine, D.: Reduced reference image quality assessment based on statistics in empirical mode decomposition domain. Signal Image Video Process. 8(8), 1663–1680 (2014)
Alaei, A., Pal, U., Nagabhushan, P.: A new scheme for unconstrained handwritten text-line segmentation. Pattern Recognit. 44(4), 917–928 (2011)
Alers, H., Redi, J., Liu, H., Heynderickx, I.: Studying the effect of optimizing image quality in salient regions at the expense of background content. J. Electron. Imaging 22(4), 043012 (2013)
Beghdadia, A., Larabib, M.-C., Bouzerdoumc, A., Iftekharuddind, K.M.: A survey of perceptual image processing methods. Signal Process. Image Commun. 28, 811–831 (2013)
Le Callet, P., Niebur, E.: Visual attention and applications in multimedia technologies. Proc. IEEE 101(9), 2058–2067 (2013)
Chandler, D.M.: Seven challenges in image quality assessment: past, present, and future research. ISRN Signal Process. 2013, 53 (2013)
Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603–619 (2002)
Engelk, U., Le Callet, P.: Perceived interest and overt visual attention in natural images. In: Signal Processing: Image Communication (2015)
Ghanem, B., Resendiz, E., Ahuja, N.: Segmentation-based perceptual image quality assessment (spiqa). In: Proceedings of the International Conference on Image Processing, pp. 393–396 (2008)
Gu, K., Wang, S., Zhai, G., Ma, S., Yang, X., Zhang, W.: Content-weighted mean-squared error for quality assessment of compressed images. Signal Image Video Process. 10(5), 803–810 (2016)
Guo, A., Zhao, D., Liu, S., Fan, X., Gao, W.: Visual attention based image quality assessment. In: Proceedings of the 18th IEEE International Conference on Image Processing, pp. 3297–3300 (2011)
Itti, L., Koch, C.: Computational modelling of visual attention. Nat. Rev. Neurosci. 2(3), 194–203 (2001)
Li, J., Zou, L., Yan, J., Deng, D., Qu, T., Xie, G.: No-reference image quality assessment using prewitt magnitude based on convolutional neural networks. Signal Image Video Process. 10(4), 609–616 (2016)
Liu, H., Engelke, U., Junle, W., Le Callet, P., Heynderickx, I.: How does image content affect the added value of visual attention in objective image quality assessment? IEEE Signal Process. Lett. 20(4), 355–358 (2013)
Liu, H., Wang, J., Redi, J., Le Callet, P., Heynderickx, I.: An efficient no-reference metric for perceived blur. In: Proceedings of the 3rd European Workshop on Visual Information Processing (EUVIP), pp. 174–179 (2011)
Mittal, A., Moorthy, A.K., Bovik, A.C., Cormack, L.K.: Automatic prediction of saliency on jpeg distorted images. In: International Workshop on Quality of Multimedia Experience, pp. 195–200 (2011)
Ninassi, A., Le Meur, O., Le Callet, P., Barbba, D.: Does where you gaze on an image affect your perception of quality? Applying visual attention to image quality metric. In: Proceedings of the 15th IEEE International Conference on Image Processing (ICIP), pp. 169–172 (2007)
Osberger, W., Bergmann, N., Maeder, A.: Automatic image quality assessment technique incorporating higher level perceptual factors. In: Proceedings of the International Conference on Image Processing, volume 3, pp. 414–418 (1998)
Ponomarenko, N., Lukin, V., Zelensky, A., Egiazarian, K., Carli, M., Battisti, F.: TID 2008—a database for evaluation of full-reference visual quality assessment metrics. Adv. Mod. Radioelectron. 10, 30–45 (2009)
Redi, J., Liu, H., Gastaldo, P., Zunino, R., Heynderickx, I.: How to apply spatial saliency into objective metrics for jpeg compressed images? In: Proceedings of the 16th IEEE International Conference on Image Processing (ICIP), pp. 961–964 (2009)
Redi, J., Liu, H., Zunino, R., Heynderickx, I.: Interactions of visual attention and quality perception. In: IS&T/SPIE Electronic, Imaging (2011)
Sheikh, H.R., Wang, Z., Cormack, L., Bovik, A.C.: Live image quality assessment database release 2 (2006)
Tong, Y., Konik, H., Cheikh, F.A., Tremeau, A.: Full reference image quality assessment based on saliency map analysis. J. Imaging Sci. Technol. 54(3), 305031–305034 (2010)
Wang, J., Barkowsky, M., Ricordeland, V., Le Callet, P.: Quantifying how the combination of blur and disparity affects the perceived depth. In: Proceedings of SPIE 7865, Human Vision and Electronic Imaging XVI, California, 2 Feb 2011
Wang, J., Chandler, D.M., Le Callet, P.: Quantifying the relationship between visual salience and visual importance. In: Proceedings of SPIE Human Vision and Electronic Imaging, volume 7527 (2010)
Wang, Z., Bovik, A.C.: Embedded foveation image coding. IEEE Trans. Image Process. 10(10), 1397–1410 (2001)
Xue, W., Zhang, L., Mou, X.: Learning without human scores for blind image quality assessment. In: IEEE Conference Computer Vision Pattern Recognition (CVPR), pp. 995 – 1002 (2013)
Xue, W., Zhang, L., Mou, X., Bovik, A.C.: Gradient magnitude similarity deviation: a highly efficient perceptual image quality index. IEEE Trans. Image Process. 23(2), 684–695 (2014)
Zhang, L., Zhang, L., Mou, X., Zhang, D.: FSIM: a feature similarity index for image quality assessment. IEEE Trans. Image Process. 20(8), 2378–2386 (2011)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Alaei, A., Raveaux, R. & Conte, D. Image quality assessment based on regions of interest. SIViP 11, 673–680 (2017). https://doi.org/10.1007/s11760-016-1009-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-016-1009-z