The Visual Computer

, Volume 27, Issue 9, pp 853–860 | Cite as

Saliency-driven scaling optimization for image retargeting

Original Article
First Online:

Abstract

This paper proposes a saliency-weighted scaling factor energy for image retargeting. Considering that salient objects should be scaled with a larger scaling factor with respect to nonsalient regions, we define a quadric energy to establish the relation between the scaling factor of a local region and its saliency. The quadric energy is the weighted sum of the square of scaling factors, where the weight of each scaling factor is inversely proportional to its corresponding saliency. Furthermore, a triangle similarity quadric energy is introduced to prevent salient regions from distortion. Compared to previous methods, our approach not only preserves the shapes of salient objects and the integrity of the whole image well, but also reserves more resolution to salient objects in target image even when the aspect ratio is unchanged.

Keywords

Image retargeting Scaling factor energy Visual saliency Mesh deformation 
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Setlur, V., Lechner, T., Nienhaus, M., Gooch, M.: Retargeting images and video for preserving information saliency. Computer Graphics and Applications 27(5), 80–88 (2007) CrossRefGoogle Scholar
  2. 2.
    Shamir, A., Avidan, S.: Seam carving for media retargeting. Communication of the ACM 52(1), 77–85 (2009) CrossRefGoogle Scholar
  3. 3.
    Liu, L., Chen, R., Wolf, L., Cohen-or, D.: Optimizing photo composition. Computer Graphics Forum (Proceedings of Eurographics) 29(2), 469–478 (2010) CrossRefGoogle Scholar
  4. 4.
    Lam, H., Baudisch, P.: Summary thumbnails: readable overviews for small screen web browsers. In: CHI 2005, pp. 681–690 Google Scholar
  5. 5.
    Avidan, S., Shamir, A.: Seam carving for content-aware image retargeting. ACM Trans. Graph. 26(3), 267–276 (2007) CrossRefGoogle Scholar
  6. 6.
    Achanta, R., Susstrunk, S.: Saliency detection for content-aware image resizing. In: ICIP 2009, pp. 1001–1004 Google Scholar
  7. 7.
    Stephan, K., Johannes, K., Hendrik, L., Wolfgang, E.: FSCAV—Fast seam carving for size adaptation of videos. In: ACM Multimedia 2009, pp. 321–330 Google Scholar
  8. 8.
    Li, Z., Ishwar, P., Konrad, J.: Video condensation by ribbon carving. IEEE Transactions on Image Processing 18(11), 2572–2583 (2009) MathSciNetCrossRefGoogle Scholar
  9. 9.
    Gal, R., Sorkine, O., Cohen-or, D.: Feature aware texturing. In: Proceedings of Eurographics Symposium on Rendering, pp. 297–303. (2006) Google Scholar
  10. 10.
    Wang, Y., Tai, C., Sorkine, O., Lee, T.: Optimized scale and stretch for image resizing. ACM Trans. Graph. 27(5), 1–8 (2008) CrossRefGoogle Scholar
  11. 11.
    Zhang, G., Cheng, M. Hu S., Martin, R.: A shape-preserving approach to image resizing. Computer Graphics Forum 28(7), 1897–1906 (2009) CrossRefGoogle Scholar
  12. 12.
    Karni, Z., Freedman, D., Gotsman, C.: Energy-based image deformation. Computer Graphics Forum 28(5), 1257–1268 (2009) CrossRefGoogle Scholar
  13. 13.
    Guo, Y., Liu, F., Shi, J., Zhou, Z., Gleicher, M.: Image retargeting using mesh parametrization. IEEE Trans. Multimedia 11(4), 856–867 (2009) Google Scholar
  14. 14.
    Ren, T., Liu, Y., Wu, G.: Image retargeting using multi-map constrained region warping. In: Proceedings of the Seventeen ACM International Conference on Multimedia, pp. 853–856. (2009) CrossRefGoogle Scholar
  15. 15.
    Pavi, D., Kobbelt, L.: Two-colored pixels. Computer Graphics Forum (Proceedings of Eurographics) 29(2), 743–752 (2010) CrossRefGoogle Scholar
  16. 16.
    Jin, Y., Liu, L., Wu, Q.: Nonhomogeneous scaling optimization for realtime image resizing. The Visual Computer 26(6), 769–778 (2010) CrossRefGoogle Scholar
  17. 17.
    Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. ACM Trans. Graph. 28(3), 1–11 (2009). 23 CrossRefGoogle Scholar
  18. 18.
    Dong, W., Paul, J.: Adaptive content-aware image resizing. Computer Graphics Forum 28(3), 1–10 (2009) Google Scholar
  19. 19.
    Dong, W., Zhou, N., Paul, J., Zhang, X.: Optimized image resizing using seam carving and scaling. ACM Trans. Graph. 28(5), 1–10 (2009). 125 CrossRefGoogle Scholar
  20. 20.
    Rubinstein, M., Shamir, A., Avidan, S.: Improved seam carving for video retargeting. ACM Trans. Graph. 27(3), 1–9 (2008) CrossRefGoogle Scholar
  21. 21.
    Philipp, K., Manuel, L., Alexanger, H.: A system for retargeting of streaming video. ACM Trans. Graph. 28(5), 126:1–10 (2009) Google Scholar
  22. 22.
    Wang, Y., Lin, H., Sorkine, O., Lee, T.: Motion-based video retargeting with optimized crop-and-warp. ACM Trans. Graph. 29(4), 90:1–9 (2010) Google Scholar
  23. 23.
    Shamir, A., Sorkine, O.: Visual media retargeting. In: Proceedings of ACM SIGGRAPH Asia Course(2009) Google Scholar
  24. 24.
    Vaquero, D., Turk, M., Pulli, K., Tico, M., Gelfand, N.: A survey of image retargeting techniques. Applications of Digital Image. Processing XXXIII, Proc. SPIE (2010) Google Scholar
  25. 25.
    Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. Advances in Neural Information Processing Systems 19, 545–552 (2007) Google Scholar

Copyright information

© Springer-Verlag 2011

Authors and Affiliations

  • Dong Wang
    • 2
  • Guiqing Li
    • 1
  • Weijia Jia
    • 2
  • Xiaonan Luo
    • 3
  1. 1.South China University of TechnologyGuangzhouChina
  2. 2.City University of Hong KongHong KongChina
  3. 3.Sun Yat-Sen UniversityGuangzhouChina

Personalised recommendations