Multimedia Tools and Applications

, Volume 78, Issue 6, pp 6889–6911 | Cite as

Adaptive image rational upscaling with local structure as constraints

  • Yang Ning
  • Yifang Liu
  • Yunfeng Zhang
  • Caiming ZhangEmail author


In this paper, we develop a new interpolation fusion model, Adaptive Image Rational Upscaling (AIRU), based on classical rational interpolation. This model can synthetically consider the influence of the surrounding 12 pixels within the current interpolation cell. Considering the limitation of edge direction estimation of conventional edge detection methods, we introduce a new method to quantify the edge direction based on the Principal Component Edge (PCE). Adaptive weights for each triangular patch can be generated based on three coefficients: angle coefficient which can be estimated by PCE, variation coefficient and gray similarity coefficient. PCE can also be used to divide the image into non-smooth and smooth area. AIRU and conventional interpolation are used in these two areas respectively. Furthermore, the model parameter optimization can further improve the interpolation performance. Experimental results demonstrate that the proposed fusion model achieves competitive performance when compared with the state-of-the-arts.


AIRU PCE Angle coefficient Variation coefficient Gray similarity coefficient Parameter optimization 



This work is supported by the National Nature Foundation of China (61602277, 61572292, 61332015), NSFC Joint Fund with Zhejiang Integration of Informatization and Industrialization under Key Project(U1609218).


  1. 1.
    Asuni N, Giachetti A (2008) Accuracy improvements and artifacts removal in edge based image interpolation. In: Proceedings of international conference on computer vision theory and applications, pp 58–65Google Scholar
  2. 2.
    Bevilacqua M, Roumy A, Guillemot C, line M, Morel A (2012) Low-complexity single-image superresolution based on nonnegative neighbor embedding. In: Proceedings of the British machine vision conference, vol 135, p 110Google Scholar
  3. 3.
    Cui CR, Ma J, Lian T, Chen ZM, Wang SQ (2015) Improving image annotation via ranking-oriented neighbor search and learning-based keyword propagation. J Assoc Inf Sci Technol 66:82–98CrossRefGoogle Scholar
  4. 4.
    Cui CR, Shen JL, Nie LQ, Hong RC, Ma J (2017) Augmented collaborative filtering for sparseness reduction in personalized POI recommendation. ACM Transactions on Intelligent Systems and TechnologyGoogle Scholar
  5. 5.
    Dong WS, Zhang L, Lukac R (2013) Sparse representation based image interpolation with nonlocal autoregressive modeling. IEEE Trans Image Process 22:1382–1394MathSciNetCrossRefGoogle Scholar
  6. 6.
    Duan Q, Djidjeli K, Price WG, Twizell EH (1999) The approximation properties of some rational cubic splines. Int J Comput 72:155–166MathSciNetCrossRefGoogle Scholar
  7. 7.
    Duan Q, Zhang HL, Zhang YF (2006) Bounded property and point control of a bivariate rational interpolating surface. Comput Math Appl 52:975–984MathSciNetCrossRefGoogle Scholar
  8. 8.
    Duan Q, Zhang YF, Twizell EH (2006) A bivariate rational interpolation and the properties. Appl Math Comput 179:190–199MathSciNetzbMATHGoogle Scholar
  9. 9.
    Edward A (2009) Interactive computer graphics: a top-down approach using OpenGL. Publishing House of Electronics Industry(PHEI), pp 64–75Google Scholar
  10. 10.
    Giachetti A, Asuni N (2011) Real-time artifact-free image upscaling. IEEE Trans Image Process 20:2760–2768MathSciNetCrossRefGoogle Scholar
  11. 11.
    Gonzalez RC, Woods RE (1992) Digital image processing. Addision-Wesley, ReadingGoogle Scholar
  12. 12.
    Hou HS, Andrew HC (1978) Cubic splines for image interpolation and digital filtering. IEEE Trans Acoust Speech Signal Process 26:508–517CrossRefGoogle Scholar
  13. 13.
    Huang JB, Singh A, Ahuja N (2015) Single image super-resolution from transformed self-exemplars.. In: IEEE conference on computer vision and pattern recognitionGoogle Scholar
  14. 14.
    Hung KW, Siu WC (2012) Robust soft-decision interpolation using weighted least square. IEEE Trans Image Process 21:1061–1069MathSciNetCrossRefGoogle Scholar
  15. 15.
    Key RG (1981) Cubic convolution interpolation for digital image processing. IEEE Trans Acoust Speech Signal Process 29:1153–1160MathSciNetCrossRefGoogle Scholar
  16. 16.
    Li X, Orchard MT (2001) New edge-directed interpolation. IEEE Trans Image Process 10:1521–1527CrossRefGoogle Scholar
  17. 17.
    Liu YF, Zhang YF, Guo Q, Zhang CM (2014) Image interpolation based on weighted and blended rational fuction. ACCV Work Image Restor Ehance 9009:78–88Google Scholar
  18. 18.
    Shezaf N, Abramov-Segal H, Sutskover I, Ran BS (2000) Adaptive low complexity algorithm for imagezooming at fractional scaling ratio.. In: Proceeding of the 21st IEEE convention of the electrical and electronic engineers, pp 253–256Google Scholar
  19. 19.
    Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images.. In: Sixth international conference on computer vision (IEEE Cat. No.98CH36271), pp 836–846Google Scholar
  20. 20.
    Yao XX, Zhang YF, Bao FX, Liu YF, Zhang CM (2018) The blending interpolation algorithm based on image features. Multimedia Tools and ApplicationsGoogle Scholar
  21. 21.
    Zeyde R, Elad M, Protter M (2012) On single image scale-up using sparse-representations. In: Curves and surfaces, pp 711–730CrossRefGoogle Scholar
  22. 22.
    Zhang L, Wu X (2006) Image interpolation via directional filtering and data fusion. IEEE Trans Image Process 15:2226–2238CrossRefGoogle Scholar
  23. 23.
    Zhang XJ, Wu XL (2008) Image interpolation by adaptive 2-D autoregressive modeling and soft-decision estimation. IEEE Trans Image Process 17:887–896MathSciNetCrossRefGoogle Scholar
  24. 24.
    Zhang X, Ma S, Zhang Y, Zhang L, Gao W (2009) Nonlocal edgedirected interpolation. In: Proceedings of advances in multimedia information processing, pp 1197–1207CrossRefGoogle Scholar
  25. 25.
    Zhang YF, Bao FX, Zhang CM (2011) Local shape control of a bivariate rational interpolating surface with mixing conditions.. In: Eighth international symposium on voronoi diagrams in science & engineering, pp 200–205Google Scholar
  26. 26.
    Zhang YF, Bao FX, Zhang CM (2012) A weighted bivariate blending rational interpolation function and visualization control. J Comput Anal Appl 14:1303–1321MathSciNetzbMATHGoogle Scholar
  27. 27.
    Zhang CM, Zhang X, Li XM, Cheng FH (2013) Cubic surface fitting to image with edges as constraints.. In: IEEE international conference on image processing (ICIP), pp 1046–1050Google Scholar
  28. 28.
    Zhang X, Liu Q, Li XM, Zhou YF, Zhang CM (2016) Non-local feature back-projection for image super-resolution. IET Image Process 10:398–408CrossRefGoogle Scholar
  29. 29.
    Zwart CM, Frakes DH (2013) Segment adaptive gradient angle interpolation. IEEE Trans Image Process 22:2960–2969MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Yang Ning
    • 1
  • Yifang Liu
    • 6
  • Yunfeng Zhang
    • 4
    • 5
  • Caiming Zhang
    • 2
    • 3
    • 4
    Email author
  1. 1.School of Computer Science and TechnologyShandong UniversityJinanChina
  2. 2.School of SoftwareShandong UniversityJinanChina
  3. 3.Shandong Co-Innovation Center of Future Intelligent ComputingYantaiChina
  4. 4.Shandong Province Key Lab of Digital Media TechnologyShandong University of Finance and EconomicsJinanChina
  5. 5.Department of Computer Science and TechnologyShandong University of Finance and EconomicsJinanChina
  6. 6.Department of Computer Science and EngineeringUniversity at BuffaloNew YorkUSA

Personalised recommendations