Flexible Online Calibration for a Mobile Projector-Camera System

  • Daisuke Abe
  • Takayuki Okatani
  • Koichiro Deguchi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6495)


This paper presents a method for calibrating a projector camera system consisting of a mobile projector, a stationary camera, and a planar screen. The method assumes the projector to be partially calibrated and the camera to be uncalibrated, and does not require any fiducials or natural markers on the screen. For the system of geometrically compensating images projected on the screen from a hand-held projector so that the images will always be displayed at a fixed position of the screen in a fixed shape, the method makes the projected images geometrically rectified; that is, it makes them have the correct rectangular shape of the correct aspect ratio. The method automatically performs this calibration online without requiring any effort on the user’s part; all the user has to do is project a video from the hand-held projector. Furthermore, when the system makes discontinuous temporal changes such as the case where the camera and/or the screen is suddenly relocated, it automatically recovers the calibrated state that was once lost. To realize these properties, we adopt the sequential LS method and extend it to be able to deal with temporal changes of the system. We show several experimental results obtained by a real system.


Window Size Projected Image Camera Image Projective Transformation Angle Error 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Raskar, R., Beardsley, P.: A self correcting projector. In: Proc. CVPR, pp. 626–631 (2001)Google Scholar
  2. 2.
    Raskar, R., van Baar, J., Beardsley, P., Willwacher, T., Rao, S., Forlines, C.: ilamps: Geometrically aware and self-configuring projectors. In: Proc. ACM SIGGRAPH (2003)Google Scholar
  3. 3.
    Rehg, J.M., Flagg, M., Cham, T.J., Sukthankar, R., Sukthankar, G.: Projected light displays using visual feedbak. In: Proc. International Conference on Control, Automation, Robotics and Vision (2002)Google Scholar
  4. 4.
    Johnson, T., Fuchs, H.: Real-time projector tracking on complex geometry using ordinary imagery. In: Proc. CVPR, pp. 1–8 (2007)Google Scholar
  5. 5.
    Okatani, T., Deguchi, K.: Easy calibration of a multi-projector display system. International Journal of Computer Vision 85, 1–18 (2009)CrossRefGoogle Scholar
  6. 6.
    Raij, A., Pollefeys, M.: Auto-calibration of multi-projector display walls. In: Proc. International Conference on Pattern Recognition (2004)Google Scholar
  7. 7.
    Cotting, D., Ziegler, R., Gross, M., Fuchs, H.: Adaptive instant displays: Continuously calibrated projections using per-pixel light control. Computer Graphics Forum 24, 705–714 (2005)CrossRefGoogle Scholar
  8. 8.
    Zhou, J., Wang, L., Akbarzadeh, A., Yang, R.: Multi-projector display with continuous self-calibration. In: Proceedings of the 5th ACM/IEEE International Workshop on Projector camera systems, PROCAMS 2008, pp. 1–7. ACM, New York (2008)CrossRefGoogle Scholar
  9. 9.
    Johnson, T., Welch, G., Fuchs, H., la Force, E., Towles, H.: A distributed cooperative framework for continuous multi-projector pose estimation. In: Proceedings of the 2009 IEEE Virtual Reality Conference, VR 2009, pp. 35–42. IEEE Computer Society, Washington, DC (2009)Google Scholar
  10. 10.
    Yang, R., Welch, G.: Automatic and continuous projector display surface calibration using every-day imagery. In: Skala, V. (ed.) Proceedings of Conference on WSCG (2001)Google Scholar
  11. 11.
    Zollmann, S., Langlotz, T., Bimber, O.: Passive-active geometric calibration for view-dependent projections onto arbitrary surfaces. Journal of Visual Reality and Broadcasting 4 (2007)Google Scholar
  12. 12.
    Okatani, T., Deguchi, K.: Autocalibration of a projector-camera system. IEEE Trans. PAMI 27, 1845–1855 (2005)CrossRefGoogle Scholar
  13. 13.
    Triggs, B.: Autocalibration from planar scenes. In: Burkhardt, H.-J., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1406, p. 89. Springer, Heidelberg (1998)Google Scholar
  14. 14.
    Zach, C., Gallup, D., Frahm, J.M.: Fast gain-adaptive KLT tracking on the GPU. In: Proc. CVGP 2008, pp. 1–7 (2008)Google Scholar
  15. 15.
    Wu, C.: SiftGPU: A GPU implementation of scale invariant feature transform,

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Daisuke Abe
    • 1
  • Takayuki Okatani
    • 1
  • Koichiro Deguchi
    • 1
  1. 1.Graduate School of Information SciencesTohoku UniversityJapan

Personalised recommendations