Visual Servoing/Tracking Using Central Catadioptric Images

  • João P. Barreto
  • Frédérick Martin
  • Radu Horaud
Conference paper
Part of the Springer Tracts in Advanced Robotics book series (STAR, volume 5)


Visual control of robot motion may benefit from enhanced camera field of view. With traditional cameras the available fields of view are only enough to view a region around the observed object (for eye-in-hand systems) or around the end-effector (for independent-eye systems). Central catadioptric systems have larger fields of view thus allowing the entire robot AND the surrounding objects to be imaged with a unique camera. Therefore, the whole robot’s articulated mechanism can be observed and its joints can be tracked and controlled simultaneously. This results in a new visual robot control concept where tracking and control are embedded together. Key to the understanding of both servoing and tracking is the central catadioptric Jacobian matrix linking the robot’s joint velocities to image observations. In spite of a more complex projection matrix associated with catadioptric sensors, we study the catadioptric Jacobian matrix and we show that it does not introduce any additional singularity with respect to the traditional pinhole camera model. Experiments showing a rigid body being tracked with a catadioptric camera are described.


Jacobian Matrix Planar Mirror Perspective Camera Catadioptric Camera Catadioptric Image 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    W. Wilson, C. Hulls, and G. Belles,“Relative end effector control using Cartesian position-based visual servoing,” IEEE Trans. on Rob. & Aut., vol. 12, no. 5, pp. 684–696, October 1996.CrossRefGoogle Scholar
  2. 2.
    B. Espiau, F. Chaumette, and P. Rives,“A new approach to visual servoing in robotics,” IEEE Trans. on Rob. & Aut., vol. 8, no. 3, pp. 313–326, June 1992.CrossRefGoogle Scholar
  3. 3.
    F. Martin and R. Horaud, “Multiple Camera Tracking of Rigid Objects”, Research report 4268INRIA, Montbonnot, France, September 2001.Google Scholar
  4. 4.
    S. Hutchinson, G. Hager, and P. I. Corke, “A tutorial on visual servo control,” IEEE Trans, on Rob. & Aut., vol. 12, no. 5, pp. 651–670, October 1996.CrossRefGoogle Scholar
  5. 5.
    J. Gluckman and S. Nayar,“Egomotion and Omnidirectional Cameras,” Proc. IEEE Int. Conf. on Computer Vision, pp. 999–1005, Bombay 1998.Google Scholar
  6. 6.
    S. Baker and S. Nayar,“A Theory of Catadioptric Image Formation,” Proc. IEEE Int. Conf. on Computer Vision, pp. 35–42, Bombay 1998.Google Scholar
  7. 7.
    T. Svoboda, T. Pajdla and V. Hlavac,“Motion Estimation Using Central Panoramic Cameras, ” Proc. IEEE Conference on Intelligent Vehicles, Stutgart Germany 1998.Google Scholar
  8. 8.
    C. Geyer and K. Daniilidis,“A Unifying Theory for Central Panoramic Systems and Practical Implications,” Proc. Eur. Conf. on Computer Vision, pp. 445–461, Dublin 2000.Google Scholar
  9. 9.
    J.P. Barreto and H. Araujo,“Geometric Properties of Central catadioptric Line Images,” Proc. Eur. Conf. on Computer Vision, Copenhag, Denmark, May 2002.Google Scholar
  10. 10.
    P. Baker, C. Fermuller, Y. Aloimonos and R. Pless,“A Spherical Eye From Multiple Cameras (Makes Better Models of the World),” in Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, Kauai, Haway, USA, December 2001.Google Scholar
  11. 11.
    F. Chaumette,“Potential Problems of Stability and Convergence in Image Based and Position Based Visual Servoing”, The Confluence of Vision and Control, Lecture Notes in Control and Information Systems, Vol. 237, pp 66–78, Springer-Verlag, 1998.Google Scholar
  12. 12.
    H. Michel and P. Rives,“Singularities in the determination of the situation of a robot effector from the perspective view of 3 points”, Research report 1850 INRIA, Sophia-Antipolis, France, February 1993.Google Scholar
  13. 13.
    A. Paulino and H. Araujo,“Multiple Robots in Geometric Formation: Control Structure and Sensing”, in Int. Symposium on Intelligent Robotic Systems, Reading, UK, 2000.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • João P. Barreto
    • 1
  • Frédérick Martin
    • 2
  • Radu Horaud
    • 2
  1. 1.Institute of Systems and Robotics DEECUniversity of CoimbraCoimbraPortugal
  2. 2.INRIA Rhône-AlpesMontbonnot St. MartinFrance

Personalised recommendations