Visual Servoing/Tracking Using Central Catadioptric Images
Visual control of robot motion may benefit from enhanced camera field of view. With traditional cameras the available fields of view are only enough to view a region around the observed object (for eye-in-hand systems) or around the end-effector (for independent-eye systems). Central catadioptric systems have larger fields of view thus allowing the entire robot AND the surrounding objects to be imaged with a unique camera. Therefore, the whole robot’s articulated mechanism can be observed and its joints can be tracked and controlled simultaneously. This results in a new visual robot control concept where tracking and control are embedded together. Key to the understanding of both servoing and tracking is the central catadioptric Jacobian matrix linking the robot’s joint velocities to image observations. In spite of a more complex projection matrix associated with catadioptric sensors, we study the catadioptric Jacobian matrix and we show that it does not introduce any additional singularity with respect to the traditional pinhole camera model. Experiments showing a rigid body being tracked with a catadioptric camera are described.
KeywordsJacobian Matrix Planar Mirror Perspective Camera Catadioptric Camera Catadioptric Image
Unable to display preview. Download preview PDF.
- 3.F. Martin and R. Horaud, “Multiple Camera Tracking of Rigid Objects”, Research report 4268INRIA, Montbonnot, France, September 2001.Google Scholar
- 5.J. Gluckman and S. Nayar,“Egomotion and Omnidirectional Cameras,” Proc. IEEE Int. Conf. on Computer Vision, pp. 999–1005, Bombay 1998.Google Scholar
- 6.S. Baker and S. Nayar,“A Theory of Catadioptric Image Formation,” Proc. IEEE Int. Conf. on Computer Vision, pp. 35–42, Bombay 1998.Google Scholar
- 7.T. Svoboda, T. Pajdla and V. Hlavac,“Motion Estimation Using Central Panoramic Cameras, ” Proc. IEEE Conference on Intelligent Vehicles, Stutgart Germany 1998.Google Scholar
- 8.C. Geyer and K. Daniilidis,“A Unifying Theory for Central Panoramic Systems and Practical Implications,” Proc. Eur. Conf. on Computer Vision, pp. 445–461, Dublin 2000.Google Scholar
- 9.J.P. Barreto and H. Araujo,“Geometric Properties of Central catadioptric Line Images,” Proc. Eur. Conf. on Computer Vision, Copenhag, Denmark, May 2002.Google Scholar
- 10.P. Baker, C. Fermuller, Y. Aloimonos and R. Pless,“A Spherical Eye From Multiple Cameras (Makes Better Models of the World),” in Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, Kauai, Haway, USA, December 2001.Google Scholar
- 11.F. Chaumette,“Potential Problems of Stability and Convergence in Image Based and Position Based Visual Servoing”, The Confluence of Vision and Control, Lecture Notes in Control and Information Systems, Vol. 237, pp 66–78, Springer-Verlag, 1998.Google Scholar
- 12.H. Michel and P. Rives,“Singularities in the determination of the situation of a robot effector from the perspective view of 3 points”, Research report 1850 INRIA, Sophia-Antipolis, France, February 1993.Google Scholar
- 13.A. Paulino and H. Araujo,“Multiple Robots in Geometric Formation: Control Structure and Sensing”, in Int. Symposium on Intelligent Robotic Systems, Reading, UK, 2000.Google Scholar