Advertisement

Soft Computing

, Volume 21, Issue 2, pp 447–457 | Cite as

Seam warping: a new approach for image retargeting for small displays

  • Lixia Zhang
  • Kangshun LiEmail author
  • Zhaoming Ou
  • Fubin Wang
Methodologies and Application

Abstract

Image retargeting is a technique to adapt an image to display on devices with different sizes and aspect ratios. When mobile devices with small displays are increasingly popular, it becomes important to retarget images that are intended for regular monitors to smaller mobile screens. Existing methods that retarget images to smaller devices, such as seam carving and warping, have some limitations: seam caving method may damage the integrity of the image, and warping method could fail when focus detection algorithm is not good. The target images obtained through the above algorithms often have obvious distortions. In this paper, we propose a new image retargeting method that combines seam caving and warping. This method preserves the advantage of warping in keeping focused areas of the image without discarding unfocused contents, and at the same time, uses seam finding scheme to address the problem of focus detection. The results of our experiment study on user preferences of retargeted images show that our approach is successful for image retargeting.

Keywords

Image retargeting Focus detection Seam Warping 

Notes

Acknowledgments

This work was jointly supported by Natural Science Foundation of Guangdong Province of China (#2014A030313454), and the National Spark Program of China (#2013GA780033).

References

  1. Achanta R, Hemami S, Estrada F, Susstrunk S (2009) Frequency-tuned salient region detection. In: Proceedings of the 2009 IEEE conference on computer vision and pattern recognition. IEEE, Miami, pp 1597–1604Google Scholar
  2. Achanta R, Susstrunk S (2009) Saliency detection for content-aware image resizing. In: IEEE Intl. Conf. on Image Processing, pp 1005–1008Google Scholar
  3. Avidan S, Shamir A (2007) Seam carving for content-aware image resizing. ACM Trans Graph 26:10–20CrossRefGoogle Scholar
  4. Barnes C, Shechtman E, Finkelstein A, Patchmatch GD (2009) A randomized correspondence algorithm for structural image editing. In ACM Trans. on graphics (Proc. of SIGGRAPH), vol 28, pp 341–352Google Scholar
  5. Brand M (2009) Image and video retargeting by darting. In: International conference on image analysis and recognition, pp 33–42Google Scholar
  6. Chen L-Q, Xie X, Fan X, Ma W-Y, Zhang H-J (2003) A visual attention model for adapting images on small displays. In: ACM Multimedia Systems JournalGoogle Scholar
  7. Cho S, Choi H, Matsushita Y, Lee S (2009) Image retargeting using importance diffusion. In: International conference on image processing, pp 977–980Google Scholar
  8. Ciocca G, Cusano C, Gasparini F, Schettini R (2007) Self-adaptive image cropping for small displays. IEEE Trans Consum Electron 53:1622–1627CrossRefGoogle Scholar
  9. Gao DS, Han SY, Vasconcelos N (2009) Discriminant saliency the detection of suspicious coincidences, and applications to visual recognition. IEEE Trans Pattern Anal Mach Intell 31:989–1005CrossRefGoogle Scholar
  10. Goferman S, Zelnik M, Tal L (2012) Context-aware saliency detection. IEEE Trans Pattern Anal Mach Intell 34:1915–1926CrossRefGoogle Scholar
  11. Guo Y, Liu F, Shi J, Zhou ZH (2009) Image retargeting using mesh parametrization. IEEE Trans Multimed 11:856–867CrossRefGoogle Scholar
  12. Itti L, Koch C, Niebur E (1998) A model of saliency-based vi-sual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20:1254–1470CrossRefGoogle Scholar
  13. Karczmarek P, Pedrycz W, Reformat M, Akhoundi E (2014) A study in facial regions saliency: a fuzzy measure approach. Soft Comput 18:379–391CrossRefGoogle Scholar
  14. Kim JS, Kim JH, Kim CS (2009) Adaptive image and video retargeting technique based on fourier analysis. In: IEEE Conference on computer vision and pattern recognition, pp 1730–1737Google Scholar
  15. Lin SS, Yeh IC, Lin CH, Lee TY (2013) Patch-based image warping for content-aware retargeting. In: ACM Trans. on graphics (Proc. of SIGGRAPH), vol 15, pp 359–368Google Scholar
  16. Liu F, Gleicher M (2005) Automatic image retargeting with fisheye view warping. In: ACM Symposium on user interface software and technology, pp 153–162Google Scholar
  17. Luo SQ, Zhang JP, Zhang Q, Yuan XR (2012) Multi-operator image retargeting with automatic integration of direct and indirect seam carving. Image Vis Comput 30:655–667CrossRefGoogle Scholar
  18. Nishiyama M, Okabe T, Sato Y, Sato I (2009) Sensation-based photo cropping. In: ACM International conference on multimedia, pp 669–672Google Scholar
  19. Pritch Y, Kav-Venaki E, Peleg S (2009) Shift-map image editing. In: IEEE International conference on computer vision, vol 30, pp 151–158Google Scholar
  20. Ren T, Liu Y, Wu G (2009) Image retargeting based on global energy optimization. In: IEEE International conference on multimedia and expo, pp 406–409Google Scholar
  21. Rubinstein M, Gutierrez D, Sorkine O, Shamir A (2010) A comparative study of image retargeting. ACM Trans Graph 29:81–95CrossRefGoogle Scholar
  22. Rubinstein M, Shamir A (2009) Multi-operator media retargeting. In: ACM Trans. on Graphics (Proc. of SIGGRAPH), vol 28, pp 1–11Google Scholar
  23. Rubinstein M, Shamir A (2008) Improved seam carving for video retargeting. ACM Trans Graph. 27:1–9CrossRefGoogle Scholar
  24. Setlur V, Takagi S, Raskar R, Gleicher M, Gooch B (2005) Automatic image retargeting. In: ACM International conference on mobile and ubiquitous multimedia, pp 59–68Google Scholar
  25. Srivastava V, Tripathi BK, Pathak VK (2014) Biometric recognition by hybridization of evolutionary fuzzy clustering with functional neural networks. J Ambient Intell Humaniz Comput 5:525–537CrossRefGoogle Scholar
  26. TalebiFard P, Leun VCM (2014) Context-aware dissemination of information and services in heterogeneous network environments. J Ambient Intell Humaniz Comput 5:775–787CrossRefGoogle Scholar
  27. Walther D, Koch C (2007) Modeling attention to salient proto-objects. Neural Networks 19:1395–1407CrossRefzbMATHGoogle Scholar
  28. Wang YS, Tai CL, Sorkine O, Lee TY (2008) Optimized scale-and-stretch for image resizing. ACM Trans Graph 27:32–39Google Scholar
  29. Wang D, Li GQ, Jia WJ, Luo XN (2011) Saliency-driven scaling optimization for image retargeting. Vis Comput 27:853–860CrossRefGoogle Scholar
  30. Wei H, Lang B, Zuo QS (2014) An image representation of infrastructure based on non-classical receptive field. Soft Comput 18:109–123CrossRefGoogle Scholar
  31. Wolf L, Guttmann M, Cohen-Or D (2007) Non-homogeneous content-driven video-retargeting. In: IEEE International conference on computer vision, pp 1–8Google Scholar
  32. Yoo S, Kim W, Kim C (2014) Saliency combined particle filtering for aircraft tracking. J Signal Process Syst 16:19–31CrossRefGoogle Scholar
  33. Zhang GX, Cheng SM, Hu MM, Martin RR (2009) A shape-preserving approach to image resizing. In: Computer Graphics Forum, vol 28, pp 1897–1906Google Scholar
  34. Zhang LX, Song HZ, Ou ZM, Liang HK, Xiao L (2010) Fisheye transformation for image retargeting. In: ICIA2010, pp 1840–1845Google Scholar
  35. Zhang LX, Song HZ, Ou ZM (2013) Image retargeting with multi-focus fisheye transformation. Vis. Comput 29:407–420CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2015

Authors and Affiliations

  1. 1.College of Mathematics and InformaticsSouth China Agricultural UniversityGuangzhouPeople’s Republic of China
  2. 2.Bingo Software Co., LtdGuangzhouPeople’s Republic of China

Personalised recommendations