Abstract
Image retargeting is a technique to adapt an original image to diverse screen sizes and aspect ratios on computing devices. This paper focuses on adapting large images for a small display. Some existing methods, such as scaling, cropping, and fisheye warping, are often flawed because they may lose the necessary details of the image, scarify content entirety, or fail to address the content continuity of images with multiple focuses. To address this issue, this paper presents a new fisheye-based approach to retarget images with multiple focuses. With fisheye-based image transformation, this approach can emphasize the focused areas of the image without completely discarding unfocused contents. With a multifocus conflict solution scheme, this approach offers a continuous content transition among multiple focused areas. With image retargeting algorithms implemented with this approach, we conducted experiments to study user preferences of retargeted images under different algorithms. The results of the experiments show that our approach is appropriate for image retargeting.
Similar content being viewed by others
References
Chen, L.Q., Xie, X., Fan, X., Ma, W.Y., Zhang, H.J., Zhou, H.Q.: A visual attention model for adapting images on small displays. ACM Multimedia Syst. J. 9(4), 353–364 (2003)
Liu, F., Gleicher, M.: Automatic image retargeting with fisheye-view warping. In: ACM Symposium on User Interface Software and Technology, pp. 153–162 (2005)
Zhang, L., Song, H., Ou, Z., Liang, H., Xiao, L.: Fisheye transformation for image retargeting. In: ICIA2010, pp. 1840–1845 (2010)
Suh, B., Ling, H., Bederson, B.B., Jacobs, D.W.: Automatic thumbnail cropping and its effectiveness. In: Proceedings UIST’03, pp. 95–104 (2003)
Ma, M., Guo, J.K.: Automatic image cropping for mobile device with built-in camera. In: IEEE Consumer Communications and Networking Conference, pp. 710–711 (2004)
Zhang, M., Zhang, L., Sun, Y., Feng, L., Ma, W.: Auto cropping for digital photographs. In: IEEE Intl. Conf. on Multimedia and Expo (2005)
Santella, A., Agrawala, M., DeCarlo, D., Salesin, D., Cohen, M.: Gaze-based interaction for semiautomatic photo cropping. In: ACM Conf. on Human Factors in Computing Systems, pp. 771–780 (2006)
Ciocca, G., Cusano, C., Gasparini, F., Schettini, R.: Self-adaptive image cropping for small displays. IEEE Trans. Consum. Electron. 53(4), 1622–1627 (2007)
Stentiford, F.W.M.: Attention based auto image cropping. In: Workshop on Computational Attention and Applications (ICVS) (2007)
Golub, E.: Photocropr: A first step towards computer-supported automatic generation of photographically interesting cropping suggestions. Tech. rep., University of Maryland HCI Lab (2007)
Amrutha, I.S., Shylaja, S.S., Natarajan, S., Balasubramanya Murthy, K.N.: A smart automatic thumbnail cropping based on attention driven regions of interest extraction. In: Intl. Conf. on Interaction Sciences, pp. 957–962 (2009)
Nishiyama, M., Okabe, T., Sato, Y., Sato, I.: Sensation-based photo cropping. In: ACM Intl. Conf. on Multimedia, pp. 669–672 (2009)
Setlur, V., Takagi, S., Raskar, R., Gleicher, M., Gooch, B.: Automatic image retargeting. In: ACM Intl. Conf. on Mobile and Ubiquitous Multimedia, pp. 59–68 (2005)
Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. ACM Trans. Graph. 26(3) (2007)
Cho, T.S., Butman, M., Avidan, S., Freeman, W.T.: The patch transform and its applications to image editing. In: IEEE Conf. on Computer Vision and Pattern Recognition (2008)
Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.: PatchMatch: a randomized correspondence algorithm for structural image editing. ACM Trans. Graph. (Proc. of SIGGRAPH) 28(3) (2009)
Pritch, Y., Kav-Venaki, E., Peleg, S.: Shift-map image editing. In: IEEE Intl. Conf. on Computer Vision, pp. 151–158 (2009)
Wolf, L., Guttmann, M., Cohen-Or, D.: Non-homogeneous content-driven video-retargeting. In: IEEE Intl. Conf. on Computer Vision (2007)
Ren, T., Guo, Y., Wu, G., Zhang, F.: Constrained sampling for image retargeting. In: IEEE Intl. Conf. on Multimedia and Expo, pp. 1397–1400 (2008)
Wang, S.-F., Lai, S.-H.: Fast structure-preserving image retargeting. In: IEEE Intl. Conf. on Acoustics, Speech and Signal Processing, pp. 1049–1052 (2009)
Kim, J.-S., Kim, J.-H., Kim, C.-S.: Adaptive image and video retargeting technique based on Fourier analysis. In: IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1730–1737 (2009)
Ren, T., Liu, Y., Wu, G.: Image retargeting based on global energy optimization. In: IEEE Intl. Conf. on Multimedia and Expo, pp. 406–409 (2009)
Brand, M.: Image and video retargeting by darting. In: Intl. Conf. on Image Analysis and Recognition, pp. 33–42 (2009)
Kim, J.-H., Kim, J.-S., Kim, C.-S.: Image and video retargeting using adaptive scaling function. In: European Signal Processing Conference (2009)
Wang, Y.-S., Tai, C.-L., Sorkine, O., Lee, T.-Y.: Optimized scale-and-stretch for image resizing. ACM Trans. Graph. (Proc. of SIGGRAPH ASIA) 27(5) (2008)
Zhang, G.-X., Cheng, M.-M., Hu, S.-M., Martin, R.R.: A shape-preserving approach to image resizing. Comput. Graph. Forum (Proc. of Pacific Graphics) 28(7), 1897–1906 (2009)
Ren, T., Liu, Y., Wu, G.: Image retargeting using multi-map constrained region warping. In: ACM Intl. Conf. on Multimedia, pp. 853–856 (2009)
Guo, Y., Liu, F., Shi, J., Zhou, Z.-H., Gleicher, M.: Image retargeting using mesh parametrization. IEEE Trans. Multimed. 11(5), 856–867 (2009)
Jin, Y., Liu, L., Wu, Q.: Nonhomogeneous scaling optimization for realtime image resizing. Vis. Comput. (Proc. of CGI) 26, 6–8 (2010)
Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. ACM Trans. Graph. (Proc. of SIGGRAPH) 28(3), 1–11 (2009)
Dong, W., Zhou, N., Paul, J.-C., Zhang, X.: Optimized image resizing using seam carving and scaling. ACM Trans. Graph. (Proc. of SIGGRAPH ASIA) 28(5), 1–10 (2009)
Liu, Z., Yan, H., Shen, L., Ngan, K.N., Zhang, Z.: Adaptive image retargeting using saliency-based continuous seam carving. Opt. Eng. 49(1) (2010)
Furnas, G.W.: The FISHEYE view: a new look at structured files. Technical report, Bell Laboratories: Murray Hill (1982)
Furnas, G.W.: Generalized fisheye views. In: Proceedings of Human Factors in Computing Systems (CHI86), pp. 16–23. ACM, New York (1986)
Robertson, G.G., Mackinlay, J.D.: The document lens. In: Proceedings of the 6th Annual ACM Symposium on User Interface Software and Technology, pp. 101–108 (1993)
Rao, R., Card, S.K.: The table lens: merging graphical and symbolic representations in an interactive focus+context visualization for tabular information. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 318–322 (1994)
Bederson, B., Clamage, A., Czerwinski, M., Robertson, G.: Datelens: a fisheye calendar interface for PDAs. ACM Trans. Comput.-Hum. Interact. 11(1), 90–119 (2004)
Bederson, B.: Fisheye menus. In: Proceedings UIST’00, pp. 217–225 (2000)
Liu, H., Xie, X., Tang, X., Li, Z.-W., Ma, W.-Y.: Effective browsing of web image search results. In: Proceedings of the 6th ACM SIGMM Workshop on Multimedia Information Retrieval (MIR’04), pp. 84–90 (2004)
Yang, C.C., Chen, H., Hong, K.K.: Visualization tools for self-organizing maps. In: Proceedings of the Fourth ACM Conference on Digital Libraries (DL’99), pp. 258–259 (1999)
WIKIPEDIA: MaxOSXDock. http://en.wikipedia.org/wiki/Mac_OS_X_Dock
Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20, 1254–1259 (1998)
Hou, X., Zhang, L.: Saliency detection: a spectral residual approach. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)
Guo, C.L., Ma, Q., Zhang, L.M.: Spatio-temporal saliency detection using phase spectrum of quaternion Fourier transform. In: IEEE Conference on Computer Vision and Pattern Recognition (2008)
Achanta, R., Hemami, S., Estrada, F., Süsstrunk, S.: Frequency-tuned salient region detection. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) (2009)
Goferman, S., Zelnik-Manor, L., Tal, A.: Context-aware saliency detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2376–2383 (2010)
Huang, Z.Y., He, F.Z., Cai, X.T., et al.: Efficient random saliency map detection. Science China 41, 863–874 (2011)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE Conf. CVPR, pp. 511–518. IEEE Press, New York (2001)
Wang, J., Ying, Y., Guo, Y., Peng, Q.S.: Automatic foreground extraction of head shoulder images. In: Computer Graphics Int’l. Lecture Notes in Computer Science, vol. 4035, pp. 385–396. Springer, Berlin (2006)
Kwon, T.M., Agrawa, P.: An ROI search method for still images based on set descriptions. Multidimens. Syst. Signal Process. 1998(9), 93–106 (1998)
Rubinstein, M., Gutierrez, D., Sorkine, O., Shamir, A.: A comparative study of image retargeting. ACM Trans. Graph. 29(6) (2010)
Acknowledgements
This work was jointly supported by National Natural Science Foundation of China (No. 60875045), and the Scientific Research Fund for the Returned Overseas Chinese Scholars, Ministry of Education of China (2007 No. 31).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, L., Song, H., Ou, Z. et al. Image retargeting with multifocus fisheye transformation. Vis Comput 29, 407–420 (2013). https://doi.org/10.1007/s00371-012-0744-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-012-0744-6