Abstract
Single-image super-resolution is of great importance for vision applications, and numerous algorithms have been proposed in recent years. Despite the demonstrated success, these results are often generated based on different assumptions using different datasets and metrics. In this paper, we present a systematic benchmark evaluation for state-of-the-art single-image super-resolution algorithms. In addition to quantitative evaluations based on conventional full-reference metrics, human subject studies are carried out to evaluate image quality based on visual perception. The benchmark evaluations demonstrate the performance and limitations of state-of-the-art algorithms which sheds light on future research in single-image super-resolution.
Chapter PDF
Similar content being viewed by others
References
Aly, H.A., Dubois, E.: Image up-sampling using total-variation regularization with a new observation model. TIP 14(10), 1647–1659 (2005)
Chang, H., Yeung, D.Y., Xiong, Y.: Super-resolution through neighbor embedding. In: CVPR (2004)
Dai, S., Han, M., Xu, W., Wu, Y., Gong, Y.: Soft edge smoothness prior for alpha channel super resolution. In: CVPR (2007)
Damera-Venkata, N., Kite, T.D., Geisler, W.S., Evans, B.L., Bovik, A.C.: Image quality assessment based on a degradation model. TIP 9(4), 636–650 (2000)
Dong, W., Zhang, L., Shi, G., Wu, X.: Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. TIP 20(7), 1838–1857 (2011)
Efrat, N., Glasner, D., Apartsin, A., Nadler, B., Levin, A.: Accurate blur models vs. image priors in single image super-resolution. In: ICCV (2013)
Elad, M., Zeyde, R., Protter, M.: Single image super-resolution using sparse representation. In: SIAM Imaging Science (2010)
Fattal, R.: Image upsampling via imposed edge statistics. In: SIGGRAPH (2007)
Freedman, G., Fattal, R.: Image and video upscaling from local self-examples. TOG 30(2), 1–11 (2011)
Freeman, W.T., Jones, T.R., Pasztor, E.C.: Example-based super-resolution. IEEE Computer Graphics and Applications, pp. 56–65 (March/April 2002)
Glasner, D., Bagon, S., Irani, M.: Super-resolution from a single image. In: ICCV (2009)
HaCohen, Y., Fattal, R., Lischinski, D.: Image upsampling via texture hallucination. In: ICCP (2010)
He, H., Siu, W.C.: Single image super-resolution using Gaussian process regression. In: CVPR (2011)
He, L., Qi, H., Zaretzki, R.: Beta process joint dictionary learning for coupled feature spaces with application to single image super-resolution. In: CVPR (2013)
Huang, J., Mumford, D.: Statistics of natural images and models. In: CVPR (1999)
Irani, M., Peleg, S.: Improving resolution by image registration. CGVIP 53(3), 231–239 (1991)
Kim, K.I., Kwon, Y.: Single-image super-resolution using sparse regression and natural image prior. PAMI 32(6), 1127–1133 (2010)
Kopf, J., Lischinski, D.: Depixelizing pixel art. In: SIGGRAPH (2011)
Lu, X., Yuan, H., Yan, P., Yuan, Y., Li, X.: Geometry constrained sparse coding for single image super-resolution. In: CVPR (2012)
Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: ICCV (2001)
Michaeli, T., Irani, M.: Nonparametric blind super-resolution. In: ICCV (2013)
Moore, D., McCabe, G.P., Craig, B.: Introduction to the Practice of Statistics, 7th edn. W.H. Freeman (2005)
Ni, K., Nguyen, T.: Image superresolution using support vector regression. TIP 16(6), 1596–1610 (2007)
Purkait, P., Chanda, B.: Image upscaling using multiple dictionaries of natural image patches. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012, Part III. LNCS, vol. 7726, pp. 284–295. Springer, Heidelberg (2013)
Robson, J.G.: Spatial and temporal contrast-sensitivity functions of the visual system. Journal of the Optical Society of America (1966)
Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: A natural scene statistics approach in the DCT domain. TIP 21(8), 3339–3352 (2012)
Shan, Q., Li, Z., Jia, J., Tang, C.K.: Fast image/video upsampling. In: SIGGRAPH Asia (2008)
Sheikh, H.R., Sabir, M.F., Bovik, A.C.: A statistical evaluation of recent full reference image quality assessment algorithms. TIP 15(11), 3340–3451 (2006)
Sheikh, H.R., Bovik, A.C., de Veciana, G.: An information fidelity criterion for image quality assessment using natural scene statistics. TIP 14(12), 2117–2128 (2005)
Sun, J., Sun, J., Xu, Z., Shum, H.Y.: Image super-resolution using gradient profile prior. In: CVPR (2008)
Sun, J., Zheng, N.N., Tao, H., Shum, H.Y.: Image hallucination with primal sketch priors. In: CVPR (2003)
Sun, J., Zhu, J., Tappen, M.F.: Context-constrained hallucination for image super-resolution. In: CVPR (2010)
Sun, L., Hays, J.: Super-resolution from internet-scale scene matching. In: ICCP (2012)
Tai, Y.W., Liu, S., Brown, M.S., Lin, S.: Super resolution using edge prior and single image detail synthesis. In: CVPR (2010)
Tappen, M.F., Liu, C.: A Bayesian approach to alignment-based image hallucination. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VII. LNCS, vol. 7578, pp. 236–249. Springer, Heidelberg (2012)
Timofte, R., Smet, V.D., Gool, L.V.: Anchored neighborhood regression for fast example-based super-resolution. In: ICCV (2012)
Wainwright, M.J., Simoncelli, E.P., Willsky, A.S.: Random cascades on wavelet trees and their use in analyzing and modeling natural images. Applied and Computational Harmonic Analysis 11, 89–123 (2001)
Wang, Q., Tang, X., Shum, H.: Patch based blind image super resolution. In: ICCV (2005)
Wang, S., Zhang, L., Liang, Y., Pan, Q.: Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis. In: CVPR (2012)
Wang, Z., Simoncelli, E., Bovik, A.C.: Multi-scale structural similarity for image quality assessment. In: IEEE Conference Record of the Thirty-Seventh Asilomar Conference on Signals, Systems, and Computers (2003)
Xiong, X., Sun, X., Wu, F.: Robust web image/video super-resolution. TIP 19(8), 2017–2028 (2010)
Yang, C.Y., Liu, S., Yang, M.H.: Structured face hallucination. In: CVPR (2013)
Yang, C.Y., Yang, M.H.: Fast direct super-resolution by simple functions. In: ICCV (2013)
Yang, J., Lin, Z., Cohen, S.: Fast image super-resolution based on in-place example regression. In: CVPR (2013)
Yang, J., Wang, Z., Lin, Z., Shu, X., Huang, T.: Bilevel sparse coding for coupled feature spaces. In: CVPR (2012)
Yang, J., Wright, J., Huang, T., Ma, Y.: Image super-resolution via sparse representation. TIP (2010)
Yang, S., Wang, M., Chen, Y., Sun, Y.: Single-image super-resolution reconstruction via learned geometric dictionaries and clustered sparse coding. TIP 21(9), 4016–4028 (2012)
Zhang, H., Yang, J., Zhang, Y., Huang, T.S.: Non-local kernel regression for image and video restoration. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part III. LNCS, vol. 6313, pp. 566–579. Springer, Heidelberg (2010)
Zontak, M., Irani, M.: Internal statistics of a single natural image. In: CVPR (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
1 Electronic Supplementary Material
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Yang, CY., Ma, C., Yang, MH. (2014). Single-Image Super-Resolution: A Benchmark. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8692. Springer, Cham. https://doi.org/10.1007/978-3-319-10593-2_25
Download citation
DOI: https://doi.org/10.1007/978-3-319-10593-2_25
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10592-5
Online ISBN: 978-3-319-10593-2
eBook Packages: Computer ScienceComputer Science (R0)