Multiple View Geometry of Projector-Camera Systems from Virtual Mutual Projection

  • Shuhei Kobayashi
  • Fumihiko Sakaue
  • Jun Sato
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5414)


Recently, projector camera systems have been used actively for image synthesis and for 3D reconstruction. For using the projector camera systems in these applications, it is very important to compute the geometry between projectors and cameras accurately. Recently, it has been shown that by using the mutual projection of cameras, multiple cameras are calibrated quite accurately. However, this property cannot be used for projector camera systems, since projectors are light-emitting devices and the projection of cameras cannot be obtained in projector images. In this paper, we show that by using the shadow of cameras and the shadow of projectors generated by projector light, we can generate virtual mutual projections between projectors and cameras, and projectors and projectors. These virtual mutual projections can be used for calibrating projector-camera systems quite accurately. Furthermore, the calibration can be achieved without using any 3D points unlike the existing calibration methods. The accuracy of the proposed method is evaluated by using real and synthetic images.


  1. 1.
    Hartley, R., Zisserman, A.: Mutiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000)zbMATHGoogle Scholar
  2. 2.
    Milgram, P., Kishino, F.: A taxonomy of mixed reality visual display. IEICE Transactions on Information and System E77-D(12), 1321–1329 (1994)Google Scholar
  3. 3.
    Nishie, K., Sato, J.: 3D reconstruction from uncalibrated cameras and uncalibrated projectors from shadows. In: Proc. International Conference on Pattern Recognition, vol. 1, pp. 15–18 (2006)Google Scholar
  4. 4.
    Oka, K., Sato, I., Nakanishi, Y., Sato, Y., Koike, H.: Interaction for entertainment contents based on direct manipulation with bare hands. In: Proc. IWEC, pp. 397–404 (2002)Google Scholar
  5. 5.
    Okatani, T., Deguchi, K.: Autocalibration of a projector-camera system. IEEE Trans. PAMI 27(12), 1845–1855 (2005)CrossRefGoogle Scholar
  6. 6.
    Sato, J.: Recovering multiple view geometry from mutual projections of multiple cameras. International Journal of Computer Vision 66(2), 123–140 (2006)CrossRefGoogle Scholar
  7. 7.
    Sukuthankar, R., Stockton, R., Mullin, M.: Smarter presentations: Exploiting homography in camera-projector systems. In: Proc. ICCV 2001 (2001)Google Scholar
  8. 8.
    Raskar, R., Beardsley, P.: A self-correcting projector. In: Proc. Computer Vision and Pattern Recognition (2001)Google Scholar
  9. 9.
    Griesser, A., Van Gool, L.: Automatic Interactive Calibration of Multi-Projector-Camera Systems. In: Proc. Conference on Computer Vision and Pattern Recognition Workshop (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Shuhei Kobayashi
    • 1
  • Fumihiko Sakaue
    • 1
  • Jun Sato
    • 1
  1. 1.Department of Computer Science and EngineeringNagoya Institute of TechnologyNagoyaJapan

Personalised recommendations