Image Super-Resolution Using Local Learnable Kernel Regression

  • Renjie Liao
  • Zengchang Qin
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7726)


In this paper, we address the problem of learning-based image super-resolution and propose a novel approach called Local Learnable Kernel Regression (LLKR). The proposed model employs a local metric learning method to improve the kernel regression for reconstructing high resolution images. We formulate the learning problem as seeking multiple optimal Mahalanobis metrics to minimize the total kernel regression errors on the training images. Through learning local metrics in the space of low resolution image patches, our method is capable to build a precise data-adaptive kernel regression model in the space of high resolution patches. Since the local metrics split the whole data set into several subspaces and the training process can be executed off-line, our method is very efficient at runtime. We demonstrate that the new developed method is comparable or even outperforms other super-resolution algorithms on benchmark test images. The experimental results also show that our algorithm can still achieve a good performance even with a large magnification factor.


Markov Random Field Image Patch Kernel Regression Bicubic Interpolation Local Metrics 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Nadaraya, E.A.: On Estimating Regression. Theory of Probability and its Applications 9, 234–778 (1964)Google Scholar
  2. 2.
    Weinberger, K.Q., Tesauro, G.: Metric Learning for Kernel Regression. JMLR 2, 612–619 (2007)Google Scholar
  3. 3.
    Yang, J.C., Wright, J., Huang, T.S., Ma, Y.: Image Super-Resolution Via Sparse Representation. IEEE Trans. Image Process. 19, 2861–2873 (2010)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Arya, S., Mount, D.M.: Approximate Nearest Neighbor Queries in Fixed Dimensions. In: SODA, pp. 271–280 (1993)Google Scholar
  5. 5.
    Glasner, D., Bagon, S., Irani, M.: Super-Resolution from a Single Image. In: ICCV (2009)Google Scholar
  6. 6.
    Hou, H.S., Andrews, H.C.: Cubic Splines for Image Interpolation and Digital Filtering. IEEE Trans. Acoustics, Speech, and Signal Processing 26, 508–517 (1978)CrossRefzbMATHGoogle Scholar
  7. 7.
    Li, X., Orchard, M.T.: New Edge Directed Interpolation. In: ICIP (2000)Google Scholar
  8. 8.
    Irani, M., Peleg, S.: Motion Analysis for Image Enhancement: Resolution, Occlusion, and Transparency. J. Visual Communication and Image Representation 4, 324–335 (1993)CrossRefGoogle Scholar
  9. 9.
    Takeda, H., Milanfar, P., Protter, M., Elad, M.: Super-Resolution Without Explicit Subpixel Motion Estimation. IEEE Trans. Image Process. 18, 1958–1975 (2009)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Freeman, W.T., Pasztor, E.C., Carmichael, O.T.: Learning Low-Level Vision. Int’l J. Computer Vision 40, 25–47 (2000)CrossRefzbMATHGoogle Scholar
  11. 11.
    Lin, Z.C., Shum, H.Y.: Fundamental Limits of Reconstruction-Based Superresolution Algorithms under Local Translation. IEEE Trans. Pattern Anal. Mach. Intell. 26, 83–97 (2004)CrossRefGoogle Scholar
  12. 12.
    Freeman, W.T., Jones, T.R., Pasztor, E.C.: Example-Based Super-Resolution. IEEE Computer Graphics and Applications 22, 56–65 (2002)CrossRefGoogle Scholar
  13. 13.
    Chang, H., Yeung, D.Y., Xiong, Y.M.: Super-Resolution through Neighbor Embedding. In: CVPR, pp. 275–282 (2004)Google Scholar
  14. 14.
    Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 13, 600–612 (2004)CrossRefGoogle Scholar
  15. 15.
    Roweis, S.T., Saul, L.K.: Nonlinear Dimensionality Reduction by Locally Linear Embedding. Science 290, 2323–2326 (2000)CrossRefGoogle Scholar
  16. 16.
    Sun, J., Xu, Z.B., Shum, H.Y.: Image super-resolution using gradient profile prior. In: CVPR, pp. 1–8 (2008)Google Scholar
  17. 17.
    Sun, J., Zheng, N.N., Tao, H., Shum, H.Y.: Image Hallucination with Primal Sketch Priors. In: CVPR, pp. 729–736 (2003)Google Scholar
  18. 18.
    Baker, S., Kanade, T.: Limits on Super-Resolution and How to Break Them. IEEE Trans. Pattern Anal. Mach. Intell., 1167–1183 (2002)Google Scholar
  19. 19.
    Fattal, R.: Image upsampling via imposed edge statistics. ACM Trans. Graph. 26 (2007)Google Scholar
  20. 20.
    Freedman, G., Fattal, R.: Image and video upscaling from local self-examples. ACM Trans. Graph. 30 (2011)Google Scholar
  21. 21.
    Shan, Q., Li, Z.R., Jia, J.Y., Tang, C.K.: Fast image/video upsampling. ACM Trans. Graph. 27 (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Renjie Liao
    • 1
  • Zengchang Qin
    • 1
  1. 1.Intelligent Computing and Machine Learning Lab, School of Automation Science and Electrical EngineeringBeihang UniversityBeijingChina

Personalised recommendations