Abstract
This paper presents a method for creating multi-viewpoint panoramas that is particularly targeted at streets with sparsely located buildings. As is known in the literature, it is impossible to create panoramas of such scenes having a wide range of depths in a distortion-free manner. To overcome this difficulty, our method renders sharp images only for the facades of buildings and the ground surface (e.g., vacant lands and sidewalks) along the target streets; it renders blurry images for other objects in the scene to make their geometric distortion less noticeable while maintaining their presence. To perform these, our method first estimates the three-dimensional structures of the target scenes using the results obtained by SfM (structure from motion), identifies to which category (i.e., the facade surface, the ground surface, or other objects) each scene point belongs based on MRF (Markov Random Field) optimization, and creates panoramic images of the scene by mosaicing the images of the three categories. The blurry images of objects are generated by a similar technique to digital refocus of the light field photography. We present several panoramic images created by our method for streets in the tsunami-devastated areas in the north-eastern Japan coastline because of the Great East Japan Earthquake of March 11, 2011.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
As our archives contain the images of the devastated areas comparatively right after the disaster, we have not make them publicly available due to privacy consideration.
References
J.Y. Zheng, Digital route panoramas. IEEE Multimedia 10(3), 57–67 (2003)
A. Zomet, D. Feldman, S. Peleg, D. Weinshall, Mosaicing new views: the clossed-slits projection. IEEE PAMI 25(6), 741–754 (2003)
A. Román, G. Garg, M. Levoy, Interactive design of multi-perspective images for visualizing urban landscapes. IEEE Vis. 17, 537–544 (2004)
A. Román, H.P.A. Lensch, Automatic multiperspective images. in Eurographisc Symposium on Rendering (2006)
A. Agarwala, M. Agrawala, M. Cohen, D. Salesin, R. Szeliski, Photographing long scenes with multi-viewpoint panoramas. ACM Trans. Graph. 25(3), 853–861 (2006)
A. Rav-Acha, G. Engel, S. Peleg, Minimal aspect distortion (MAD) mosaicing of long scenes. Int. J. Comput. Vis. 78(2–3), 187–206 (2008)
J. Kopf, B. Chen, R. Szeliski, M. Cohen, Street slide: Browsing street level imagery. ACM Trans. Graph. (Proc. SIGGRAPH 2010) 29(4), 961–968 (2010)
S.M. Seitz, J. Kim, Multiperspective imaging. IEEE Comput. Graph. Appl. 23(6), 16–19 (2003)
T. Adelson, J.Y.A. Wang, Single lens stereo with a plenoptic camera. IEEE PAMI 14(2), 99–106 (1992)
R. Ng, M. Levoy, M. Brédif, G. Duval, M. Horowitz, P. Hanrahan, Light field photography with a hand-held plenotric camera (Stanford University Computer Science, Tech. Rep. 2005)
R. Guputa, R.I. Hartley, Linear pushbroom cameras. IEEE PAMI 19(9), 963–975 (1997)
Y. Boykov, O. Veksler, R. Zabih, Efficient approximate energy minimization via graph cuts. IEEE PAMI 20(12), 1222–1239 (2001)
V. Kolmogorov, R. Zabih, What energy functions can be minimized via graph cuts? IEEE PAMI 26(2), 147–159 (2004)
Y. Boykov, V. Kolmogorov, An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE PAMI 26(9), 1124–1137 (2004)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Okatani, T., Yanagisawa, J., Tetsuka, D., Sakurada, K., Deguchi, K. (2014). Creating Multi-Viewpoint Panoramas of Streets with Sparsely Located Buildings. In: Yoshida, K., Tadokoro, S. (eds) Field and Service Robotics. Springer Tracts in Advanced Robotics, vol 92. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40686-7_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-40686-7_5
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40685-0
Online ISBN: 978-3-642-40686-7
eBook Packages: EngineeringEngineering (R0)