Advertisement

Springer Nature is making Coronavirus research free. View research | View latest news | Sign up for updates

Similar Reference Image Quality Assessment: A New Database and A Trial with Local Feature Matching

  • 228 Accesses

Abstract

Conventionally, the reference image for image quality assessment (IQA) is completely available (full-reference IQA) or unavailable (no-reference IQA). Even for reduced-reference IQA, the features that are used to predict image quality are still extracted from the pristine reference image. However, the pristine reference image is always unavailable in many real scenarios. In contrast, it is convenient to obtain a number of similar reference images via retrieval from the Internet. These similar reference images may share similar contents and scenes with the image to be assessed. In this paper, we attempt to discuss the image quality assessment problem from the view of similar images, i.e. similar reference IQA. Although the similar reference images share similar contents with the degraded image, the difference between them still cannot be ignored. Therefore, we propose an IQA framework based on local feature matching, which can help to identify the similar regions and structures. Then the IQA features are computed only from these similar regions to predict the final image quality score. Besides, since there is no IQA databases for the similar reference IQA problem, we establish a novel IQA database that consists of 272 images from four scenes. The experiments demonstrate that the performance of our scheme goes beyond state-of-the-art no-reference IQA methods and some full-reference IQA algorithms.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Notes

  1. 1.

    http://home.ustc.edu.cn/~luqingbo

References

  1. 1.

    Liu, C., Freeman, W., Szeliski, R., & Kang, S. B. (2006). Noise estimation from a single image. Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) (Vol. 1, pp. 901–908).

  2. 2.

    Liu, Y., Wang, J., Cho, S., Finkelstein, A., & Rusinkiewicz, S. (2013). A no-reference metric for evaluating the quality of motion deblurring. ACM Transactions on Graphics (TOG), 32(6), 175:1–175:12.

  3. 3.

    Wang, Z. (2011). Applications of objective image quality assessment methods [applications corner]. IEEE Signal Processing Magazine, 28(6), 137–142.

  4. 4.

    Manap, R. A., & Shao, L. (2015). Non-distortion-specific no-reference image quality assessment: A survey. Information Sciences, 301, 141–160.

  5. 5.

    Wang, Z., Bovik, A., Sheikh, H., & Simoncelli, E. (2004). Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing (TIP), 13(4), 600–612.

  6. 6.

    Zhang, L., Zhang, D., Mou, X., & Zhang, D. (2011). FSIM: A feature similarity index for image quality assessment. IEEE Transactions on Image Processing (TIP), 20(8), 2378–2386.

  7. 7.

    Li, S., Zhang, F., Ma, L., & Ngan, K. N. (2011). Image quality assessment by separately evaluating detail losses and additive impairments. IEEE Transactions on Multimedia (TMM), 13(5), 935–949.

  8. 8.

    Sheikh, H., & Bovik, A. (2006). Image information and visual quality. IEEE Transactions on Image Processing (TIP), 15(2), 430–444.

  9. 9.

    Moorthy, A., & Bovik, A. (2011). Blind image quality assessment: From natural scene statistics to perceptual quality. IEEE Transactions on Image Processing (TIP), 20(12), 3350–3364.

  10. 10.

    Mittal, A., Moorthy, A., & Bovik, A. (2012). No-reference image quality assessment in the spatial domain. IEEE Transactions on Image Processing (TIP), 21(12), 4695–4708.

  11. 11.

    Ye, P., Kumar, J., Kang, L., & Doermann, D. (2012). Unsupervised feature learning framework for no-reference image quality assessment. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1098–1105).

  12. 12.

    Tang, H., Joshi, N., & Kapoor, A. (2014). Blind image quality assessment using semi-supervised rectifier networks. Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 2877–2884).

  13. 13.

    Rehman, A., & Wang, Z. (2012). Reduced-reference image quality assessment by structural similarity estimation. IEEE Transactions on Image Processing (TIP), 21(8), 3378–3389.

  14. 14.

    Lowe, D. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision (IJCV), 60(2), 91–110.

  15. 15.

    Bay, H., Ess, A., Tuytelaars, T., & Gool, L. V. (2008). Speeded-up robust features (SURF). Computer Vision and Image Understanding, 110(3), 346–359.

  16. 16.

    Philbin, J., Chum, O., Isard, M., Sivic, J., & Zisserman, A. (2007). Object retrieval with large vocabularies and fast spatial matching. Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1–8).

  17. 17.

    Velmurugan, K., & Baboo, L. S. (2011). Content-based image retrieval using SURF and colour moments. Global Journal of Computer Science and Technology, 11, 10.

  18. 18.

    Saad, M., Bovik, A., & Charrier, C. (2012). Blind image quality assessment: A natural scene statistics approach in the DCT domain. IEEE Transactions on Image Processing (TIP), 21(8), 3339–3352.

  19. 19.

    Li, Q., & Wang, Z. (2009). Reduced-reference image quality assessment using divisive normalization-based image representation. IEEE Journal of Selected Topics in Signal Processing, 3(2), 202–211.

  20. 20.

    Ma, L., Li, S., Zhang, F., & Ngan, K. N. (2011). Reduced-reference image quality assessment using reorganized DCT-based image representation. IEEE Transactions on Multimedia (TMM), 13(4), 824–829.

  21. 21.

    Chandler, D. M. (2013). Seven challenges in image quality assessment: Past, present, and future research. ISRN Signal Processing, 2013(905682), 1–53.

  22. 22.

    Kakadu JPEG2000 compression software. http://perso.telecom-paristech.fr/~cagnazzo/si390.php.

  23. 23.

    Sheikh, H., Sabir, M., & Bovik, A. (2006). A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Transactions on Image Processing (TIP), 15(11), 3440–3451.

  24. 24.

    Methodology for Subjective Assessment of the Quality of Television Pictures Recommendation BT.500-11, International Telecommunication Union, Geneva, Switzerland (2002).

  25. 25.

    Ponomarenko, N., Lukin, V., Zelensky, A., Egiazarian, K., Astola, J., Carli, M., et al. (2009). TID2008—A database for evaluation of full-reference visual quality assessment metrics. Advances of Modern Radioelectronics, 10, 30–45.

  26. 26.

    Liu, Z., Li, H., Zhang, L., Zhou, W., & Tian, Q. (2014). Cross-indexing of binary SIFT codes for large-scale image search. IEEE Transactions on Image Processing (TIP), 23(5), 2047–2057.

  27. 27.

    Feature Detection and Description of OpenCV. http://docs.opencv.org/modules/nonfree/doc/feature_detection.html.

  28. 28.

    Moorthy, A., & Bovik, A. (2009). Visual importance pooling for image quality assessment. IEEE Journal of Selected Topics in Signal Processing, 3(2), 193–201.

  29. 29.

    Serre, T., Wolf, L., & Poggio, T. (2005). Object recognition with features inspired by visual cortex. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 994–1000).

  30. 30.

    Smola, A., & Schlkopf, B. (2004). A tutorial on support vector regression. Statistics and Computing, 14(3), 199–222.

  31. 31.

    Chang, C.-C., & Lin, C.-J., LIBSVM—A library for support vector machines. http://www.csie.ntu.edu.tw/~cjlin/libsvm/.

  32. 32.

    Zhang, L., Shen, Y., & Li, H. (2014). VSI: A visual saliency-induced index for perceptual image quality assessment. IEEE Transactions on Image Processing (TIP), 23(10), 4270–4281.

  33. 33.

    Larson, E., Chandler, D. M. Categorical image quality assessment (CSIQ) database. http://vision.okstate.edu/?loc=csiq.

  34. 34.

    Sheikh, H., Wang, Z., Cormack, L., & Bovik, A., LIVE image quality assessment database release 2. http://live.ece.utexas.edu/research/quality.

  35. 35.

    The OpenCV User Guide Relase 2.4.9.0. (2014). http://docs.opencv.org/opencv_user.pdf.

  36. 36.

    Liu, Z., Li, H., Zhou, W., Hong, R., & Tian, Q. (2015). Uniting keypoints: Local visual information fusion for large-scale image search. IEEE Transactions on Multimedia (TMM), 17(4), 538–548.

Download references

Acknowledgements

This work has been supported in part by 973 Program under Contract 2015CB351803, Natural Science Foundation of China (NSFC) under Contract 61325009 and Contract 61390514, and the Fundamental Research Funds for the Central Universities under Contract WK2100060011.

Author information

Correspondence to Wengang Zhou or Houqiang Li.

Additional information

This article is part of the Topical Collection on Image Quality Assessment for Sensing.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Lu, Q., Zhou, W. & Li, H. Similar Reference Image Quality Assessment: A New Database and A Trial with Local Feature Matching. Sens Imaging 17, 23 (2016). https://doi.org/10.1007/s11220-016-0149-0

Download citation

Keywords

  • Image quality assessment
  • IQA database
  • Local feature matching
  • Similar reference IQA