Journal of Intelligent & Robotic Systems

, Volume 65, Issue 1–4, pp 309–323

View Planning for Multi-View Stereo 3D Reconstruction Using an Autonomous Multicopter

  • Korbinian Schmid
  • Heiko Hirschmüller
  • Andreas Dömel
  • Iris Grixa
  • Michael Suppa
  • Gerd Hirzinger
Article

Abstract

Multi-view stereo algorithms are an attractive technique for the digital reconstruction of outdoor sites. Concerning the data acquisition process a vertical take off and landing UAV carrying a digital camera is a suitable platform in terms of mobility and flexibility in viewpoint placement. We introduce an automated UAV based data acquisition and outdoor site reconstruction system. A special focus is set on the problem of model based view planning using a coarse digital surface model (DSM) with minimal data preprocessing. The developed view planning heuristic considers a coverage, a maximum view angle and an overlapping constraint imposed by multi-view stereo reconstruction techniques. The time complexity of the algorithm is linear with respect to the size of the area of interest. We demonstrate the efficiency of the entire system in two scenarios, a building and a hillside.

Keywords

UAV Multicopter View planning 3D Reconstruction SGM 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Adolf, F.M., Hirschmüller, H.: Meshing and simplification of high resolution urban surface data for UAV path planning. J. Intell. Robot. Syst. 61(1), 169–180 (2011)CrossRefGoogle Scholar
  2. 2.
    Akbarzadeh, A., Frahm, J.M., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Merrell, P., Phelps, M., Sinha, S., Talton, B., et al.: Towards urban 3d reconstruction from video. In: Third International Symposium on, 3D Data Processing, Visualization, and Transmission. IEEE, Piscataway, Chapel Hill, NC, USA (2007)Google Scholar
  3. 3.
    Blaer, P.S., Allen, P.K.: Data acquisition and view planning for 3-d modeling tasks. In: IEEE/RSJ IROS. San Diego, CA (2007)Google Scholar
  4. 4.
    Cowan, C.K., Kovesi, P.D.: Automatic sensor placement from vision task requirements. IEEE Trans. Pattern Anal. Mach. Intell. 10, 407–416 (1988)CrossRefGoogle Scholar
  5. 5.
    Eisenbeiss, H.: The autonomous mini helicopter: a powerful platform for mobile mapping. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 37, 977–983 (2008)Google Scholar
  6. 6.
    El-Hakim, S.F., Beraldin, J.A., Picard, M., Vettore, A.: Effective 3d modeling of heritage sites. In: Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings, pp. 302–309. IEEE, Piscataway, Banff, Canada (2005)Google Scholar
  7. 7.
    Frueh, C., Zakhor, A.: Constructing 3d city models by merging ground-based and airborne views. In: 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings, vol. 2. IEEE, Piscataway (2003)Google Scholar
  8. 8.
    Hirschmüller, H.: Stereo processing by semi-global matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 328–341 (2008)CrossRefGoogle Scholar
  9. 9.
    Hirschmüller, H., Scharstein, D.: Evaluation of stereo matching costs on images with radiometric differences. IEEE Trans. Pattern Anal. Mach. Intell. 31(9), 1582–1599 (2009)CrossRefGoogle Scholar
  10. 10.
    Kim, Z.W., Nevatia, R.: Automatic description of complex buildings from multiple images. Comput. Vis. Image Underst. 96(1), 60–95 (2004)CrossRefGoogle Scholar
  11. 11.
    Scott, W.R., Roth, G., Rivest, J.F.: View planning with a registration constraint. In: Third International Conference on 3-D Digital Imaging and Modeling 2001. Proceedings, pp. 127–134. IEEE, Piscataway, Quebec City, Canada (2002)Google Scholar
  12. 12.
    Scott, W.R., Roth, G., Rivest, J.F.: View planning for automated three-dimensional object reconstruction and inspection. ACM Comput. Surv. (CSUR) 35(1), 64–96 (2003)CrossRefGoogle Scholar
  13. 13.
    Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring image collections in 3d. In: ACM Transactions on Graphics (Proceedings of the SIGGRAPH) (2006)Google Scholar
  14. 14.
    Tarabanis, K., Tsai, R.Y., Abrams, S.: Planning viewpoints that simultaneously satisfy several feature detectability constraints for robotic vision. In: Fifth International Conference on Advanced Robotics, 1991. ‘Robots in Unstructured Environments’, 91 ICAR, pp. 1410–1415. IEEE, Piscataway, Pisa, Italy (2002)Google Scholar
  15. 15.
    Tarbox, G.H., Gottschlich, S.N.: IVIS: an integrated volumetric inspection system. In: Proceedings of the 1994 Second CAD-Based Vision Workshop 1994, pp. 220–227. IEEE, Piscataway, Los Alamitos, CA, USA (2002)Google Scholar
  16. 16.
    Tony, H.H., Derose, T., Duchamp, T., Mcdonald, J., Stuetzle, W.: Surface Reconstruction from Unorganized Points (1992)Google Scholar

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  • Korbinian Schmid
    • 1
  • Heiko Hirschmüller
    • 1
  • Andreas Dömel
    • 1
  • Iris Grixa
    • 1
  • Michael Suppa
    • 1
  • Gerd Hirzinger
    • 2
  1. 1.Department of Perception and Cognition, Robotics and Mechatronics Center (RMC)German Aerospace Center (DLR)WesslingGermany
  2. 2.Robotics and Mechatronics Center (RMC)German Aerospace Center (DLR)WesslingGermany

Personalised recommendations