Skip to main content
SpringerLink
Log in

Content-aware image resizing using quasi-conformal mapping

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Content-aware image resizing is resizing an image such that the prominent feature of the image is intact and the homogenous content of the image is distorted as little as possible. There is a lot of research on this topic, and various approaches have been proposed so far. One problem with previous methods is the lack of a theoretical guarantee of a rigorous bijective map between an image and the target image, which may cause artifacts in the target image. In this paper, we present a new approach to solve the image resizing problem based on quasi-conformal mapping. We apply quasi-conformal mapping to set up a bijective map between an image and the target image such that the salient feature of the image is uniformly scaled, while the homogenous content of the image is distorted as little as possible. The distortion is characterized by a function defined by the Beltrami coefficient of the quasi-conformal mapping, which is minimized by solving a nonconvex optimization problem. Solving the optimization problem is reduced to solving two convex optimization problems alternatingly. We implemented our algorithm with many examples and made comparisons with previous approaches. The examples suggest that our method is comparable with previous approaches while guaranteeing that there are no foldovers. Furthermore, our method can easily preserve line features and handle large changes in the aspect ratios of images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Gal, R., Sorkine, O., Cohen, D.: Feature-aware texturing, In: Proc. Symp. Rendering, Volume, 297–303 (2006)

  2. Avidan, S., Shamir, A.: Seam carving for content-aware image resizing, ACM TOG(Proc. SIGGRAPH), 26(3), 267–276 (2007)

  3. Wang, Y. S., Tai, C. L., Sorkine, O., Lee, T. Y.: Optimized scale-and-stretch for image resizing, ACM TOG(Proc. SIGGRAPH Asia), 27(5), 1–8(2008)

  4. Karni, Z., Freedman, D., Gotsman, C.: Energy-based image deformation, SGP’09 Proceedings of the Symposium on Geometry Processing, 28(5), 1257–1268(2009)

  5. Zhang, G.X., Cheng, M.M., Hu, S.M., Martin, R.R.: A shape preserving approach to image resizing. Comput. Graph. Forum 28(7), 1897–1906 (2009)

    Article  Google Scholar 

  6. Guo, Y., Liu, F., Shi, J., Zhou, Z., Gleicher, M.: Image retargeting using mesh parameterization. IEEE Trans. Multimedia 11(5), 856–867 (2009)

    Article  Google Scholar 

  7. Jin, Y., Liu, L.G., Wu, Q.B.: Nonhomogeneous scaling optimization for realtime image resizing. The visual Computer 26(6–8), 769–778 (2010)

    Article  Google Scholar 

  8. Chen, R. J., Freedman, D., Karni, Z., et al.: Content-aware image resizing by quadratic programming, Proceedings of the 2010 IEEE CVPR WorkShop on NORDIA. Florida, USA: IEEE, 1–8(2010)

  9. Panozzo, D., Weber, O., Sorking, O.: Robust image retargeting via axis-aligned deformation. Eurographics 31(2), 229–236 (2012)

    Google Scholar 

  10. Lin, S.S., Yeh, I.C., Lin, C.H.: Patch-based image warping for content-aware retargeting. IEEE Trans. Multimed. 15(2), 359–368 (2013)

    Article  Google Scholar 

  11. Ahlfors, L.: Conformality with respect to riemannian matrices. Ann. Acad. Sci. Fenn. Ser. 206, 1–22 (1955)

    MATH  Google Scholar 

  12. Shi, M.L., Peng, G.Q., Yang, L., Xu, D.: Optimal Bi-directional Seam Carving for Content-Aware Image Resizing. Digital Techniques and Systems, Lecture Notes in Computer Science 6249, 456–467 (2010)

  13. Ahlfors, L.: Lectures on Quasiconformal Mappings(Second edition). Amer. Mathematical Sorciety, Rhode Island (2006)

  14. Gardiner, F., Lakic, N.: Quasiconformal Teichmüller Theory. Amer. Mathematical Sorciety, New York (2000)

    MATH  Google Scholar 

  15. Zeng, W., Luo, F., Yau, S.T., Gu, X.D.: Surface quasi-conformal mapping by solving beltrami equations, IMA Conference on the Mathematics of Surfaces, pp. 391–408 (2009)

  16. Lui, L.M., Wong, T.W., Gu, X.F., Thompson, P.M., Chan, T.F., Yau, S.T.: Hippocampal Shape Registration using Beltrami Holomorphic flow, Medical Image Computing and Computer Assisted Intervention(MICCAI). Part II, LNCS 6362, pp. 323–330 (2010)

  17. Zeng, W., Gu, X.F.: Registration for 3d surfaces with large deformations using quasi-conformal curvature flow, In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2457C2464 (2011)

  18. Lipman, Y.: Bounded distortion mapping spaces for triangular meshes. ACM TOG 31(4), 108 (2012)

    Article  Google Scholar 

  19. Zeng, W., Lui, L.M., Luo, F., Chan, T.F., Yau, S.T., Gu, X.F.: Computing quasiconformal maps using an auxiliary metric and discrete curvature flow. Numer. Math. 121, 671–703 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  20. Lui, L.M., Wong, T.W., Zeng, W., Gu, X., Thompson, P.M., Chan, T.F., Yau, S.-T.: Optimization of surface registrations using beltrami holomorphic flow. J. Sci. Comput. (JSC) 50(3), 557–585 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  21. Lam, K.C., Lui, L.M.: Landmark- and intensity-based registration with large deformations via quasi-conformal maps. Siam J. Imagin. Sci. 7(4), 2364–2392 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  22. Lui, L.M., Lam, K.C., Yau, S.T., Gu, X.F.: Teichmüller Mapping(T-Map) and its application to landmark matching registration. Siam J. Imagin. Sci. 7(1), 391–426 (2014)

    Article  MATH  Google Scholar 

  23. Lui, L.M., Ng, T.C.: A splitting method for diffeomorphism optimization problem using beltrami coefficients. J. Sci. Comput. 63, 573–611 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  24. Lee, Y.T., Lam, K.C., Lui, L.M.: Landmark-matching transformation with large deformation via n-dimensional quasi-conformal maps. J. Sci. Comput. 67, 926–954 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  25. Nian, X., Chen, F.: Planar Domain Parameterization For Isogeometric Analysis Based On Teichmuller Mapping, Comput. Methods Appl. Mech. Eng., doi:10.1016/j.cma.2016.07.035

  26. Nian, X., Chen, F.: Planar shape interpolation based on Teichmller mapping. In: Proceedings of Pacific Graphics, to appear, Computer Graphics Forum (2016)

  27. Levi, Z., Weber, O.: On the Convexity and Feasibility of the Bounded Distortion Harmonic Mapping Problem, ACM Trans. Graph. 35, 4, Article 106 (July 2016), 15 pages. DOI:10.1145/2897824.2925929

  28. Chien, E., Chen, R., Weber, O.: Bounded Distortion Harmonic Shape Interpolation, ACM Trans. Graph. 35, 4, Article 105 (July 2016), 15 pages. DOI:10.1145/2897824.2925926

  29. Weber, O., Myles, A., Zorin, D.: Computing extremal quasiconformal maps. Comput. Graph. Forum 31(5), 1679–1689 (2012)

    Article  Google Scholar 

  30. Goferman, S., Zelnik-Manor, L., Tal, A.: Context-aware saliency detection. IEEE Trans. Pattern Anal. Mach. Intell. 34(10), 1915–1926 (2012)

    Article  Google Scholar 

  31. Yan, Q., Xu, L., Shi, J., jia, J.: Hierarchical saliency detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1155–1162(2013)

  32. Achanta, R., Hemami, S., Estrada, F., Susstrunk, S.: Frequency-tuned salient region detection. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2009), 1597–1604(2009).

  33. Ho, Kin Tat, Lui, Lok Ming: QCMC:quasi-conformal parameterization for multiply-connected domains. Advances in Computational Mathmetics 42, 279–312 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  34. Aigerman, N., Lipman, Y.: Injective and Bounded Distortion Mappings in 3D, ACM Trans. Graphics 32, No.4, July 2013, Article No. 106 (2013)

  35. Zhang, L., Liu, L., Gotsman, C., Gortler, S.J.: An as-rigid-as-possible approach to sensor network localization. ACM Transactions on Sensor Networks 6(4), 1–12 (2010)

    Article  Google Scholar 

Download references

Acknowledgements

The work is supported by the Open Project Program of the State Key Lab of CAD&CG (Grant No. A1602), Zhejiang University.

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, China

    Jinlan Xu

  2. School of Mathematical Sciences, University of Science and Technology of China, Hefei, China

    Hongmei Kang & Falai Chen

Authors
  1. Jinlan Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hongmei Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Falai Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jinlan Xu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, J., Kang, H. & Chen, F. Content-aware image resizing using quasi-conformal mapping. Vis Comput 34, 431–442 (2018). https://doi.org/10.1007/s00371-017-1350-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-017-1350-4

Keywords

Search

Navigation