Reliable Omnidirectional Depth Map Generation for Indoor Mobile Robot Navigation Via a Single Perspective Camera
This paper deals with the problem of finding the largest navigable areas around a mobile robot, which is important for navigation and action planning. We propose a method to obtain reliable dense 3D maps using a novel omnidirectional stereo vision system. The vision system is composed of a perspective camera and two hyperbolic mirrors. Once the system has been calibrated and two image points respectively projected by upper and below mirrors are matched, the 3D coordinate of the space point can be acquired by means of triangulation. To achieve the largest reliable dense matching, our method are divided into three steps. First reliable FX-dominant matching; then feature matching and ambiguous removal; finally the remaining points between features are matched using dynamic time warping(DTW) with modified energy functions adapted well to our system. Experiments show that this proposed vision system is feasible as a practical stereo sensor for accurate 3D map generation.
KeywordsMobile Robot Dynamic Time Warping Feature Match Stereo Vision Stereo Match
Unable to display preview. Download preview PDF.
- 1.Gluckman, J., Nayar, S.K., Thoresz, K.J.: Real-time Omnidirectional and Panoramic Stereo. In: Proc. DARPA Image Understanding Workshop, pp. 299–303 (1998)Google Scholar
- 2.Ma, J.: Omnidirectional Vision Based Localization and Path Planning for Mobile Robots. Doctor Thesis of Beijing Instititue of Technology (2003)Google Scholar
- 3.Southwell, M.F.D., Basu, A., Reyda, J.: Panoramic Stereo. In: Proc. International Conf. on Pattern Recognition, pp. 378–382 (1996)Google Scholar
- 4.Cabral, E.L.L., de Souza Jr., J.C., Hunold, M.C.: Omnidirectional Stereo Vision with a Hyperbolic Double Lobed Mirror. In: Proc. International Conf. on Pattern Recognition, pp. 1–4 (2004)Google Scholar
- 5.Su, L., Zhu, F.: Design of a Novel Stereo Vision Navigation System for Mobile Robots. In: Proc. IEEE Conf. on Robotics and Biomimetics, vol. 1, pp. 611–614 (2005)Google Scholar
- 7.Geyer, C., Daniilidis, K.: Conformal Rectification of Omnidirectional Stereo Pairs. In: Proc. IEEE Workshop on Omnidirectional Vision and Camera Networks, vol. 7, pp. 1–6 (2003)Google Scholar
- 8.Koyasu, H., Miura, J., Shirai, Y.: Mobile Robot Navigation in Dynamic Environment using Omnidirectional Stereo. In: Proc. IEEE Conf. on Robotics and Automation, pp. 893–898 (2003)Google Scholar
- 10.Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient Belief Propagation for Early Vision. International Journal of Computer Vision 70(1) (2006) (to appear)Google Scholar
- 11.Devernay, F., Faugeras, O.: Computing Differential Properties of 3-D Shapes from Stereoscopic Images without 3-D Models. In: Proc. CVPR, pp. 208–213 (1994)Google Scholar
- 12.Sara, R.: The Class of Stable Matchings for Computational Stereo. Research Report CTUCMP- 1999-22, Center for Machine Perception, Czech Technical University (2001)Google Scholar
- 14.Manduchi, R., Tomasi, C.: Distinctiveness Maps for Image Matching. In: Proc. International Conf. on Image Analysis and Processing, pp. 26–31 (1999)Google Scholar