Abstract
An imaging system with a single effective viewpoint is called a central projection system. The conventional perspective camera is an example of central projection system. A catadioptric realization of omnidirectional vision combines reflective surfaces with lenses. Catadioptric systems with an unique projection center are also examples of central projection systems. Whenever an image is acquired, points in 3D space are mapped into points in the 2D image plane. The image formation process represents a transformation from ℜ3 to ℜ2, and mathematical models can be used to describe it. This paper discusses the definition of world coordinate systems that simplify the modeling of general central projection imaging. We show that an adequate choice of the world coordinate reference system can be highly advantageous. Such a choice does not imply that new information will be available in the images. Instead the geometric transformations will be represented in a common and more compact framework, while simultaneously enabling newer insights. The first part of the paper focuses on static imaging systems that include both perspective cameras and catadioptric systems. A systematic approach to select the world reference frame is presented. In particular we derive coordinate systems that satisfy two differential constraints (the “compactness” and the “decoupling” constraints). These coordinate systems have several advantages for the representation of the transformations between the 3D world and the image plane. The second part of the paper applies the derived mathematical framework to active tracking of moving targets. In applications of visual control of motion the relationship between motion in the scene and image motion must be established. In the case of active tracking of moving targets these relationships become more complex due to camera motion. Suitable world coordinate reference systems are defined for three distinct situations: perspective camera with planar translation motion, perspective camera with pan and tilt rotation motion, and catadioptric imaging system rotating around an axis going through the effective viewpoint and the camera center. Position and velocity equations relating image motion, camera motion and target 3D motion are derived and discussed. Control laws to perform active tracking of moving targets using visual information are established.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Baker, S. and Nayar, S. 1998. A theory of catadioptric image formation. In Proc. of IEEE International Conference on Computer Vision, Bombay, pp. 35–42.
Barreto, J.P. and Araujo, H. 2001. Issues on the geometry of central catadioptric imaging. In Proc. of the IEEE Int. Conf. on Computer Vision and Pattern Recognition, Kauai, Haway, USA.
Barreto, J.P., Batista, J. and Araujo, H. 1999a. Tracking multiple targets in 3d. In IROS99—IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Kyongju, Korea, pp. 233–246.
Barreto, J.P., Peixoto, P., Batista, J., and Araujo, H. 1999b. Evaluation of the robustness of visual behaviors through performance characterization. In Robust Vision for Vision-Based Control of Motion, Markus Vincze and Gregory D. Hager (Eds.), IEEE Press.
Barreto, J.P., Peixoto, P., Batista, J., and Araujo, H. 1999c. Improving 3d active visual tracking. In Computer Vision Systems, Lectures Notes in Computer Science, vol. 1542, Henrik I. Christensen (Ed.), Springer.
Barreto, J.P., Peixoto, P., Batista, J., and Araujo, H. 2000. Mathematical analysis for visual tracking assuming perspective projection. In SIRS2000—8th Int. Symposium on Intelligent Robotic Systems, Reading, England, pp. 233–246.
Batista, J., Dias, J., Araujo, H., and Almeida, A. 1995. The isr multi-degree-of-freedom active vision robot head: Design and calibration. In Proc. of M2VIP'95—Second International Conference on Mechatronics and Machine Vision in Practice, Hong-Kong.
Batista, J., Peixoto, P., and Araujo, H. 1997. Real-time visual behaviors with a binocular vision system. In ICRA97—IEEE International Conference on Robotics and Automation, New Mexico.
Bogner, S. 1995. Introduction to panoramic imaging. In Proc. of IEEE SMC Conference, pp. 3100–3106.
Chroust, S., Vincze, M., Traxl, R., and Krautgartner, P. 2000. Evaluation of processing architecture and control law on the performance of vision-based control systems. In AMC00–IEEE/RSJ Int. Workshop on Advanced Motion Control, Japan, pp. 19–24.
Corke, P.I. 1996. Visual Control of Robots: High-Peformance Visual Servoing. Mechatronics, John Wiley.
Courant, R. 1998. Differential and Integral Calculus. Wiley Classic Library.
Geyer, C. and Daniilidis, K. 2000. An unifying theory for central panoramic systems and pratical implications. In Proc. of European Conference on Computer Vision, Dublin, pp. 445–461.
Gluckman, J. and Nayar, S. 1998. Egomotion and omnidirectional cameras. In Proc. of IEEE International Conference on Computer Vision, Bombay, pp. 999–1005.
Hartley, R. and Zisserman, A. 2000. Multiple View Geometry in Computer Vision. Cambridge University Press.
Hecht, E. and Zajac, A. 1974. Optics. Addison-Wesley.
Krautgartner, P. and Vincze, M. 1998. Performance evaluation of vision-based control tasks. In IEEE International Confernce on Robotics and Automation, Leuven, Belgium.
Laveau, S. and Faugeras, O. 1996. Oriented projective geometry for computer vision. In Proc. of European Conference on Computer Vision.
Malis, E., Chaumette, F., and Boudet, S. 1999. 2 1/2 d visual servoing. IEEE Trans. on Robotics and Automation, 15(2):238–250.
Murray, R.M., Li, Z., and Sastry, S. 1994. A Mathematical Introduction to Robotic Manipulation. CRC Press.
Nalwa, V.S. 1996. A true omnidirectional viewer. Technical Report, Bell Laboratories, Holmdel, NJ, USA.
Sharkey, P., Murray, D., Vandevelde, S., Reid, I., and Mclauchlan, P. 1993. A modular head/eye platform for real-time reactive vision. Mechatronics, 3(4):517–535.
Stolfi, J. 1991. Oriented Projective Geometry. Academic Press Inc.
Svoboda, T., Padjla, T., and Hlavac, V. 1998. Epipolar geometry for panoramic cameras. In Proc. of European Conference on Computer Vision, Freiburg, Germany, pp. 218–332.
Yagi, Y. and Kawato, S. 1990. Panoramic scene analysis with conic projection. In Proc. of the International Conference on Robots and Systems.
Yamazawa, K. Yagi, Y., and Yachida, M. 1993. Omnidirectional imaging with hyperboloidal projection. In Proc. of the International Conference on Robots and Systems.
Yamazawa, K. and Yagi, Y., and Yachida, M. 1995 Obstacle avoidance with omnidirectional image sensor hyperomni vision. In Proc. of the IEEE International Conference on Robotics and Automation, pp. 1062–1067.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Barreto, J.P., Araujo, H. A General Framework for the Selection of World Coordinate Systems in Perspective and Catadioptric Imaging Applications. International Journal of Computer Vision 57, 23–47 (2004). https://doi.org/10.1023/B:VISI.0000013089.51664.b2
Issue Date:
DOI: https://doi.org/10.1023/B:VISI.0000013089.51664.b2