Machine Vision and Applications

, Volume 15, Issue 2, pp 92–100 | Cite as

Fusion of laser and visual data for robot motion planning and collision avoidance

  • Haris Baltzakis
  • Antonis Argyros
  • Panos TrahaniasEmail author


In this paper, a method for inferring scene structure information based on both laser and visual data is proposed. Common laser scanners employed in contemporary robotic systems provide accurate range measurements, but only in 2D slices of the environment. On the other hand, vision is capable of providing dense 3D information of the environment. The proposed fusion scheme combines the accuracy of laser sensors with the broad visual fields of cameras toward extracting accurate scene structure information. Data fusion is achieved by validating 3D structure assumptions formed according to 2D range scans of the environment, through the exploitation of visual information. The proposed methodology is applied to robot motion planning and collision avoidance tasks by using a suitably modified version of the vector field histogram algorithm. Experimental results confirm the effectiveness of the proposed methodology.


Sensor fusion Laser range scanner Stereo vision Collision avoidance Motion planning 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Baltzakis H, Argyros A, Trahanias P (2002) Fusion of range and visual data for the extraction of scene structure information. In: Proceedings of the international conference on pattern recognition, Quebec, 11-15 August 2002, pp 40007-40012Google Scholar
  2. 2.
    Baltzakis H, Trahanias P (2003) A hybrid framework for mobile robot localization: formulation using switching state-space models. Autonomous Robots J 15:169-191Google Scholar
  3. 3.
    Borenstein J, Koren Y (1991) The vector field histogram: fast obstacle avoidance for mobile robots. IEEE Trans Robot Autom 7(3):278-288Google Scholar
  4. 4.
    Castellanos J, Tardós J, Neira J (1996) Constraint-based mobile robot localization. In: Proceedings of the international workshop on advanced robotics and intelligence machines, University of Salford, Manchester, UK, 2-3 April 1996Google Scholar
  5. 5.
    Duda R, Hart P (1973) Pattern classification and scene analysis. Wiley-Interscience, New YorkGoogle Scholar
  6. 6.
    Fornland P (1995) Direct obstacle detection and motion from spatio-temporal derivatives. In: Proceedings of the 6th international conference on computer analysis of images and patterns, Prague, Czech Republic, 6-8 September 1995, pp 874-879Google Scholar
  7. 7.
    Gutmann JS, Konolige K (1999) Incremental mapping of large cyclic environments. In: Proceedings of the international symposium on computer intelligence in robotics and automation, Monterey, CA, 8-9 November 2000, pp 318-325Google Scholar
  8. 8.
    Kanatani K (1993) Geometric computation for machine vision. Clarendon Press, OxfordGoogle Scholar
  9. 9.
    Matthies L, Grandjean P (1994) Stochastic performance modeling and evaluation of obstacle detectability with imaging range sensors. IEEE Trans Robot Autom 10:783-792Google Scholar
  10. 10.
    Michael T, Quint T (1994) Sphere of influence graphs in general metric spaces. Math Comp Model 29:45-53zbMATHGoogle Scholar
  11. 11.
    Moravec HP, Elfes A (1985) High resolution maps from wide angle sonar. In: Proceedings of the international conference on robots and automation, St. Louis, MO, 25-28 March 1985, pp 116-121Google Scholar
  12. 12.
    Stiller C, Hipp J, Rossig C, Ewald A (2000) Multisensor obstacle detection and tracking. Image Vision Comp 18(5):389-396Google Scholar
  13. 13.
    Thrun S, Buecken A, Burgard W, Fox D, Froehlinghaus T, Hennig D, Hofmann T, Krell M, Schmidt T (1996) Map learning and high-speed navigation in RHINO. Technical report IAI-TR-96-3, University of Bonn, Department of Computer ScienceGoogle Scholar
  14. 14.
    Zhang Z, Weiss R, Hanson A (1997) Obstacle detection based on qualitative and quantitative 3D reconstruction. IEEE Trans Patt Anal Mach Intell 19(1):15-26Google Scholar

Copyright information

© Springer-Verlag Berlin/Heidelberg 2003

Authors and Affiliations

  • Haris Baltzakis
    • 1
    • 2
  • Antonis Argyros
    • 1
  • Panos Trahanias
    • 1
    • 2
    Email author
  1. 1.Foundation for Research and Technology - Hellas (FORTH)Institute of Computer ScienceHeraklionCrete, Greece
  2. 2.Department of Computer ScienceUniversity of CreteHeraklionCrete,Greece

Personalised recommendations