Creating Multi-Viewpoint Panoramas of Streets with Sparsely Located Buildings

  • Takayuki Okatani
  • Jun Yanagisawa
  • Daiki Tetsuka
  • Ken Sakurada
  • Koichiro Deguchi
Part of the Springer Tracts in Advanced Robotics book series (STAR, volume 92)


This paper presents a method for creating multi-viewpoint panoramas that is particularly targeted at streets with sparsely located buildings. As is known in the literature, it is impossible to create panoramas of such scenes having a wide range of depths in a distortion-free manner. To overcome this difficulty, our method renders sharp images only for the facades of buildings and the ground surface (e.g., vacant lands and sidewalks) along the target streets; it renders blurry images for other objects in the scene to make their geometric distortion less noticeable while maintaining their presence. To perform these, our method first estimates the three-dimensional structures of the target scenes using the results obtained by SfM (structure from motion), identifies to which category (i.e., the facade surface, the ground surface, or other objects) each scene point belongs based on MRF (Markov Random Field) optimization, and creates panoramic images of the scene by mosaicing the images of the three categories. The blurry images of objects are generated by a similar technique to digital refocus of the light field photography. We present several panoramic images created by our method for streets in the tsunami-devastated areas in the north-eastern Japan coastline because of the Great East Japan Earthquake of March 11, 2011.


Ground Surface Point Cloud Panoramic Image Street View Vacant Land 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    J.Y. Zheng, Digital route panoramas. IEEE Multimedia 10(3), 57–67 (2003)Google Scholar
  2. 2.
    A. Zomet, D. Feldman, S. Peleg, D. Weinshall, Mosaicing new views: the clossed-slits projection. IEEE PAMI 25(6), 741–754 (2003)Google Scholar
  3. 3.
    A. Román, G. Garg, M. Levoy, Interactive design of multi-perspective images for visualizing urban landscapes. IEEE Vis. 17, 537–544 (2004)Google Scholar
  4. 4.
    A. Román, H.P.A. Lensch, Automatic multiperspective images. in Eurographisc Symposium on Rendering (2006)Google Scholar
  5. 5.
    A. Agarwala, M. Agrawala, M. Cohen, D. Salesin, R. Szeliski, Photographing long scenes with multi-viewpoint panoramas. ACM Trans. Graph. 25(3), 853–861 (2006)Google Scholar
  6. 6.
    A. Rav-Acha, G. Engel, S. Peleg, Minimal aspect distortion (MAD) mosaicing of long scenes. Int. J. Comput. Vis. 78(2–3), 187–206 (2008)Google Scholar
  7. 7.
    J. Kopf, B. Chen, R. Szeliski, M. Cohen, Street slide: Browsing street level imagery. ACM Trans. Graph. (Proc. SIGGRAPH 2010) 29(4), 961–968 (2010)Google Scholar
  8. 8.
    S.M. Seitz, J. Kim, Multiperspective imaging. IEEE Comput. Graph. Appl. 23(6), 16–19 (2003)Google Scholar
  9. 9.
    T. Adelson, J.Y.A. Wang, Single lens stereo with a plenoptic camera. IEEE PAMI 14(2), 99–106 (1992)Google Scholar
  10. 10.
    R. Ng, M. Levoy, M. Brédif, G. Duval, M. Horowitz, P. Hanrahan, Light field photography with a hand-held plenotric camera (Stanford University Computer Science, Tech. Rep. 2005)Google Scholar
  11. 11.
    R. Guputa, R.I. Hartley, Linear pushbroom cameras. IEEE PAMI 19(9), 963–975 (1997)Google Scholar
  12. 12.
    Y. Boykov, O. Veksler, R. Zabih, Efficient approximate energy minimization via graph cuts. IEEE PAMI 20(12), 1222–1239 (2001)Google Scholar
  13. 13.
    V. Kolmogorov, R. Zabih, What energy functions can be minimized via graph cuts? IEEE PAMI 26(2), 147–159 (2004)Google Scholar
  14. 14.
    Y. Boykov, V. Kolmogorov, An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE PAMI 26(9), 1124–1137 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Takayuki Okatani
    • 1
  • Jun Yanagisawa
    • 1
  • Daiki Tetsuka
    • 1
  • Ken Sakurada
    • 1
  • Koichiro Deguchi
    • 1
  1. 1.Tohoku UniversitySendaiJapan

Personalised recommendations