International Journal of Computer Vision

, Volume 35, Issue 2, pp 175–196

A Theory of Single-Viewpoint Catadioptric Image Formation

  • Simon Baker
  • Shree K. Nayar
Article

Abstract

Conventional video cameras have limited fields of view which make them restrictive for certain applications in computational vision. A catadioptric sensor uses a combination of lenses and mirrors placed in a carefully arranged configuration to capture a much wider field of view. One important design goal for catadioptric sensors is choosing the shapes of the mirrors in a way that ensures that the complete catadioptric system has a single effective viewpoint. The reason a single viewpoint is so desirable is that it is a requirement for the generation of pure perspective images from the sensed images. In this paper, we derive the complete class of single-lens single-mirror catadioptric sensors that have a single viewpoint. We describe all of the solutions in detail, including the degenerate ones, with reference to many of the catadioptric systems that have been proposed in the literature. In addition, we derive a simple expression for the spatial resolution of a catadioptric sensor in terms of the resolution of the cameras used to construct it. Moreover, we include detailed analysis of the defocus blur caused by the use of a curved mirror in a catadioptric sensor.

image formation sensor design sensor resolution defocus blur omnidirectional imaging panoramic imaging 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Adelson, E.H. and Bergen, J.R. 1991. The plenoptic function and elements of early vision. In Computational Models of Visual Processing, chap. 1, Landy and Movshon (Eds.), MIT Press.Google Scholar
  2. Baker, S. and Nayar, S.K. 1998. A theory of catadioptric image formation. In Proceedings of the 6th Internation Conference on Computer Vision, Bombay, India, IEEE Computer Society, pp. 35–42.Google Scholar
  3. Bogner, S. 1995. Introduction to panoramic imaging. In Proceedings of the IEEE SMC Conference, pp. 3100–3106.Google Scholar
  4. Born, M. and Wolf, E. 1965. Principles of Optics. Permagon Press.Google Scholar
  5. Chahl, J.S. and Srinivassan, M.V. 1997. Reflective surfaces for panoramic imaging. Applied Optics, 36(31):8275_8285.Google Scholar
  6. Charles, J.R., Reeves, R., and Schur, C. 1987. How to build and use an all-sky camera. Astronomy Magazine, April.Google Scholar
  7. Drucker, D. and Locke, P. 1996. A natural classification of curves and surfaces with reflection properties. Mathematics Magazine, 69(4):249–256.Google Scholar
  8. Gortler, S.J., Grzeszczuk, R., Szeliski, R., and Cohen, M. 1996. The lumigraph. In Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, pp. 43–54.Google Scholar
  9. Goshtasby, A. and Gruver, W.A. 1993. Design of a single-lens stereo camera system. Pattern Recognition, 26(6):923–937.Google Scholar
  10. Hecht, E. and Zajac, A. Optics. Addison-Wesley.Google Scholar
  11. Hong, J. 1991. Image based homing. In Proceedings of the IEEE International Conference on Robotics and Automation.Google Scholar
  12. Inaba, M., Hara, T., and Inoue, H. 1993. A stereo viewer based on a single camera with view-control mechanism. In Proceedings of the International Conference on Robots and Systems.Google Scholar
  13. Murphy, J.R. 1995. Application of panoramic imaging to a teleoperated lunar rover. In Proceedings of the IEEE SMC Conferences, pp. 3117–3121.Google Scholar
  14. Nalwa, V.S. 1996. A true omnidirectional viewer. Technical Report, Bell Laboratories, Holmdel, NJ 07733, USA.Google Scholar
  15. Nayar, S.K. 1988. Sphereo: Recovering depth using a single camera and two specular spheres. In Proceedings of SPIE: Optics, Illumination, and Image Sensing for Machine Vision II.Google Scholar
  16. Nayar, S.K. 1997a. Catadioptric omnidirectional camera. In Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition, pp. 482–488.Google Scholar
  17. Nayar, S.K. 1997b. Omnidirectional video camera. In Proceedings of the 1997 DARPA Image Understanding Workshop.Google Scholar
  18. Nayar, S.K. and Baker, S. 1997. Catadioptric image formation. In Proceedings of the 1997 DARPA Image UnderstandingWorkshop, New Orleans, Louisiana, pp. 1431–1437.Google Scholar
  19. Nene, S.A. and Nayar, S.K. 1998. Stereo with mirrors. In Proceedings of the 6th Internation Conference on Computer Vision, Bombay, India, IEEE Computer Society.Google Scholar
  20. Peri, V. and Nayar, S.K. 1997. Generation of perspective and panoramic video from omnidirectional video. In Proceedings of the 1997 DARPA Image Understanding Workshop, New Orleans. Rees, D.W. 1970. Panoramic television viewing system. United States Patent No. 3,505,465.Google Scholar
  21. Yagi, Y. and Kawato, S. 1990. Panoramic scene analysis with conic projection. In Proceedings of the International Conference on Robots and Systems.Google Scholar
  22. Yagi, Y., Kawato, S., and Tsuji, S. 1994. Real-time omnidirectional image sensor (COPIS) for vision-guided navigation. IEEE Transactions on Robotics and Automation, 10(1):11–22.Google Scholar
  23. Yagi, Y. and Yachida, M. 1991. Real-time generation of environmental map and obstacle avoidance using omnidirectional image sensor with conic mirror. In Proceedings of the 1991 Conference on Computer Vision and Pattern Recognition, pp. 160–165.Google Scholar
  24. Yamazawa, K., Yagi, Y., and Yachida, M. 1993. Omnidirectional imaging with hyperboloidal projection. In Proceedings of the International Conference on Robots and Systems.Google Scholar
  25. Yamazawa, K., Yagi, Y., and Yachida, M. 1995. Obstacle avoidance with omnidirectional image sensor HyperOmni Vision. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1062–1067.Google Scholar

Copyright information

© Kluwer Academic Publishers 1999

Authors and Affiliations

  • Simon Baker
    • 1
  • Shree K. Nayar
    • 2
  1. 1.The Robotics InstituteCarnegie Mellon UniversityPittsburgh
  2. 2.Department of Computer ScienceColumbia UniversityNew York

Personalised recommendations