Saliency-Driven Variational Retargeting for Historical Maps

  • Filippo BergamascoEmail author
  • Arianna Traviglia
  • Andrea Torsello
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11130)


We study the problem of georeferencing artistic historical maps. Since they were primarily conceived as work of art more than an accurate cartographic tool, the common warping approaches implemented in Geographic Application Systems (GIS) usually lead to an overly-stretched image in which the actual pictorial content (like written text, compass roses, buildings, etc.) is un-naturally deformed. On the other hand, domain transformation of images driven by the perceived salient visual content is a well-known topic known as “image retargeting” which has been mostly limited to a change of scale of the image (i.e. changing the width and height) rather than a more general control-points based warping.

In this work we propose a variational image retargeting approach in which the local transformations are estimated to accommodate a set of control points instead of image boundaries. The direction and severity of warping is modulated by a novel tensor-based saliency formulation considering both the visual content and the shape of the underlying features to transform. The optimization includes a flow projection step based on the isotonic regression to avoid singularities and flip overs of the resulting distortion map.


Image retargeting Warping Historical maps 


  1. 1.
    Abadi, M., et al.: TensorFlow: Large-scale machine learning on heterogeneous systems (2015). Software available from
  2. 2.
    Achanta, R., Süsstrunk, S.: Saliency detection for content-aware image resizing. In: Proceedings of the 16th IEEE International Conference on Image Processing, ICIP 2009, pp. 1001–1004. IEEE Press, Piscataway (2009)Google Scholar
  3. 3.
    Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. ACM Trans. Graph. 26(3) (2007). Scholar
  4. 4.
    Chakravarti, N.: Isotonic median regression: a linear programming approach. Math. Oper. Res. 14(2), 303–308 (1989). Scholar
  5. 5.
    Gal, R., Sorkine, O., Cohen-Or, D.: Feature-aware texturing. In: Proceedings of the 17th Eurographics Conference on Rendering Techniques, EGSR 2006, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, pp. 297–303 (2006).
  6. 6.
    Guo, Y., Liu, F., Shi, J., Zhou, Z.H., Gleicher, M.: Image retargeting using mesh parametrization. IEEE Trans. Multimedia 11(5), 856–867 (2009). Scholar
  7. 7.
    Lin, S.S., Yeh, I.C., Lin, C.H., Lee, T.Y.: Patch-based image warping for content-aware retargeting. IEEE Trans. Multimedia 15(2), 359–368 (2013). Scholar
  8. 8.
    Pritch, Y., Kav-Venaki, E., Peleg, S.: Shift-map image editing. In: ICCV, pp. 151–158. IEEE Computer Society (2009).
  9. 9.
    Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. ACM Trans. Graph. 28(3) (2009). Scholar
  10. 10.
    Shamir, A., Sorkine, O.: Visual media retargeting. In: ACM SIGGRAPH ASIA 2009 Courses, SIGGRAPH ASIA 2009, pp. 11:1–11:13. ACM, New York (2009).
  11. 11.
    Wang, Y.S., Tai, C.L., Sorkine, O., Lee, T.Y.: Optimized scale-and-stretch for image resizing. ACM Trans. Graph. 27(5), 118 (2008). Scholar
  12. 12.
    Wolf, L., Guttmann, M., Cohen-Or, D.: Non-homogeneous content-driven video-retargeting. In: ICCV, pp. 1–6. IEEE Computer Society (2007).
  13. 13.
    Zhang, G.X., Cheng, M.M., Hu, S.M., Martin, R.R.: A shape-preserving approach to image resizing. Comput. Graph. Forum 28(7), 1897–1906 (2009)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.DAIS - Università Ca’FoscariVeniceItaly
  2. 2.Istituto Italiano di Tecnologia (IIT), Center for Cultural Heritage Technology (CCHT)VeniceItaly

Personalised recommendations