Geometry Estimation of Urban Street Canyons Using Stereo Vision from Egocentric View

  • Tobias SchwarzeEmail author
  • Martin Lauer
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 325)


We investigate the problem of estimating the local geometric scene structure of urban street canyons captured from an egocentric viewpoint with a small-baseline stereo camera setup. We model the facades of buildings as planar surfaces and estimate their parameters based on a dense disparity map as only input. After demonstrating the importance of considering the stereo reconstruction uncertainties, we present two approaches to solve this model-fitting problem. The first approach is based on robust planar segmentation using random sampling, the second approach transforms the disparity into an elevation map from which the main building orientations can be obtained. We evaluate both approaches on a set of challenging inner city scenes and show how visual odometry can be incorporated to keep track of the estimated geometry in real-time.


Environment perception Geometry estimation Robust plane fitting 



The work was supported by the German Federal Ministry of Education and Research within the project OIWOB. The authors would like to thank the “Karlsruhe School of Optics and Photonics” for supporting this work.


  1. 1.
    Geiger, A., Lauer, M., Urtasun, R.: A generative model for 3d urban scene understanding from movable platforms. In: CVPR’11, Colorado Springs, USA (2011)Google Scholar
  2. 2.
    Cornelis, N., Leibe, B., Cornelis, K., Gool, L.V.: 3d urban scene modeling integrating recognition and reconstruction. Int. J. Comput. Vis. 78(2–3), 121–141 (2008)CrossRefGoogle Scholar
  3. 3.
    Hoiem, D., Efros, A.A., Hebert, M.: Recovering surface layout from an image. Int. J. Comput. Vis. 75, 151–172 (2007)Google Scholar
  4. 4.
    Barinova, O., Lempitsky, V., Tretiak, E., Kohli, P.: Geometric image parsing in man-made environments. In: ECCV’10, pp. 57–70. Springer, Berlin (2010)Google Scholar
  5. 5.
    Lee, D.C., Hebert, M., Kanade, T.: Geometric reasoning for single image structure recovery. In: CVPR’09 (2009)Google Scholar
  6. 6.
    Hoover, A., Jean-baptiste, G., Jiang, X., Flynn, P.J., Bunke, H., Goldgof, D.B., Bowyer, K., Eggert, D.W., Fitzgibbon, A., Fisher, R.B.: An experimental comparison of range image segmentation algorithms. Pattern. Anal. Mach. Intell. IEEE. Trans. On. 18(7), 673–689 (1996)Google Scholar
  7. 7.
    Gutmann, J.S., Fukuchi, M., Fujita, M.: 3D perception and environment map generation for humanoid robot navigation. Int. J. Robot. Res. 27(10), 1117–1134 (2008)CrossRefGoogle Scholar
  8. 8.
    Poppinga, J., Vaskevicius, N., Birk, A., Pathak, K.: Fast plane detection and polygonalization in noisy 3D range images. In: IROS’08 (2008)Google Scholar
  9. 9.
    Iocchi, L., Konolige, K., Bajracharya, M.: Visually realistic mapping of a planar environment with stereo. ISER 271, 521–532 (2000)Google Scholar
  10. 10.
    Labayrade, R., Aubert, D., Tarel, J.P.: Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation. In: Intelligent Vehicle Symposium, Vol. 2, pp. 646–651 (2002)Google Scholar
  11. 11.
    Se, S., Brady, M.: Ground plane estimation, error analysis and applications. Robot. Autonom. Syst. 39(2), 59–71 (2002)CrossRefGoogle Scholar
  12. 12.
    Chumerin, N., Van Hulle, M.M.: Ground plane estimation based on dense stereo disparity, pp. 209–213. In: ICNNAI’08, Minsk, Belarus (2008)Google Scholar
  13. 13.
    Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)Google Scholar
  14. 14.
    Murray, D.R., Little, J.J.: Environment modeling with stereo vision. In: IROS’04 (2004)Google Scholar
  15. 15.
    Schindler, K., Bischof, H.: On robust regression in photogrammetric point clouds. In: Michaelis, B., Krell, G., (Eds.) DAGM-Symposium, Vol. 2781 of Lecture Notes in Computer Science, pp. 172–178. Springer, Berlin (2003)Google Scholar
  16. 16.
    Hough, P.: Method and means for recognizing complex patterns. U.S. Patent 3.069.654 (1962)Google Scholar
  17. 17.
    Borrmann, D., Elseberg, J., Lingemann, K., Nüchter, A.: The 3d hough transform for plane detection in point clouds: A review and a new accumulator design. 3D Res. 2(2), 32:1–32:13 (2011)Google Scholar
  18. 18.
    Geiger, A., Ziegler, J., Stiller, C.: Stereoscan: dense 3d reconstruction in real-time. In: IEEE Intelligent Vehicles Symposium, Baden-Baden, Germany (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Institute of Measurement and Control SystemsKarlsruhe Institute of TechnologyKarlsruheGermany

Personalised recommendations