A Versatile Method for Omnidirectional Stereo Camera Calibration Based on BP Algorithm
This study describes a full model of calibrating an omnidirectional stereo vision system, which includes the rotation and translation between the camera and mirrors, and an algorithm implemented with a backpropagation technique of the neural network to determine this relative position from observations of known points in a single image. The system is composed of a perspective camera and two hyperbolic mirrors, which are configured to be separate and coaxial besides sharing one focus that coincides with the camera center for providing a single projection point. We divide the calibration into two steps. The first step we calibrate the camera’s intrinsics without the mirrors in order to reduce computational complexity and in the second step we estimate the pose parameters of the CCD camera with respect to the mirrors based on a Levenberg-Marquart Backpropagation (LMBP) algorithm. The proposed tech- nique can be easily applied to all kinds of catadioptric sensors and various amounts of misalignment between the mirrors and cameras.
KeywordsStereo Match Epipolar Line World Coordinate System Mobile Robot Navigation Camera Center
Unable to display preview. Download preview PDF.
- Nayar, S.K.: Catadioptric Omnidirectional Camera. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 482–488 (1997)Google Scholar
- Gluckman, J., Nayar, S.K., Thoresz, K.J.: Real-time Omnidirectional and Panoramic Stereo. In: Proc. DARPA Image Understanding Workshop, pp. 299–303 (1998)Google Scholar
- Koyasu, H., Miura, J., Shirai, Y.: Recognizing Moving Obstacles for Robot Navigation Using Real-time Omnidirectional Stereo Vision. Journal of Robotics and Mechatronics 14(2), 147–156 (2002)Google Scholar
- Ma, J.: Omnidirectional Vision Based Localization and Path Planning for Mobile Robots. Doctor Thesis of Beijing Institute of Technology (2003)Google Scholar
- Southwell, M.F.D., Basu, A., Reyda, J.: Panoramic stereo. In: Proc. International Conf. on Pattern Recognition, pp. 378–382 (1996)Google Scholar
- Conroy, T.L., Moore, J.B.: Resolution invariant surfaces for panoramic vision systems. In: Proc. IEEE International Conf. on Computer Vision, pp. 392–397 (1999)Google Scholar
- Cabral, E.L.L., de Souza Jr., J.C., Hunold, M.C.: Omnidirectional Stereo Vision with a Hyperbolic Double Lobed Mirror. In: Proc. International Conf. on Pattern recognition, pp. 1–4 (2004)Google Scholar
- Su, L., Zhu, F.: Design of a Novel Stereo Vision Navigation System for Mobile Robots. In: Proc. IEEE Conf. on Robotics and Biomimetics, vol. 1, pp. 611–614 (2005)Google Scholar
- Geyer, C., Daniilidis, K.: Conformal Rectification of Omnidirectional Stereo Pairs. In: Proc. IEEE Workshop on Omnidirectional Vision and Camera Networks, vol. 7, pp. 1–6 (2003)Google Scholar