A Handheld Projector Supported by Computer Vision

  • Akash Kushal
  • Jeroen van Baar
  • Ramesh Raskar
  • Paul Beardsley
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3852)


This paper describes the use of computer vision to support the operation of a handheld projector, and describes four applications. Projectors in the past have been used as fixed devices, but the latest generation of ‘pocket projectors’ is small and portable. We demonstrate the feasibility of using a projector held in the hand, and the types of applications that can be done with a handheld projector.

We attach a camera to the projector to support its operation in two ways. Firstly, vision is used to recover the motion of the projector relative to the display surface. A handheld projector with motion recovery allows a range of interesting functionality, and we show how web-browsing can be done with a handheld projector, complete with mouse interaction and text-entry. Secondly, we use the camera to process information about the projection surface – for example we demonstrate an application that allows a user to attach digital information to a physical texture, and later to recover and view the digital data via recognition of the texture.


Augmented Reality Laser Spot Display Surface Base Frame Distinct View 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Dan Jr., R.O., Nielsen, T.: Laser pointer interaction. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 17–22. ACM Press, New York (2001)Google Scholar
  2. 2.
    Sukthankar, R., Stockton, R.G., Mullin, M.D.: Automatic keystone correction for camera-assisted presentation interfaces. In: Proc. Intl. Conf. Multimedia Interfaces 2000 (2000)Google Scholar
  3. 3.
    Pinhanez, C.: Using a steerable projector and a camera to transform surfaces into interactive displays. In: CHI 2001: CHI 2001 extended abstracts on Human factors in computing systems, pp. 369–370. ACM Press, New York (2001)CrossRefGoogle Scholar
  4. 4.
    Ashdown, M., Sato, Y.: Steerable projector calibration. In: Proc. IEEE Workshop on Projector-Camera Systems (2005)Google Scholar
  5. 5.
    Raskar, R., Van Baar, J., Beardsley, P.A., Willwacher, T., Rao, S., Forlines, C.: iLamps: Geometrically aware and self-configuring projectors. In: SIGGRAPH 2003 Conference Proceedings (2003)Google Scholar
  6. 6.
    Beardsley, P.A., van Baar, J., Raskar, R., Forlines, C.: Interaction using a handheld projector. IEEE Computer Graphics and Applications 25(1), 39–43 (2005)CrossRefGoogle Scholar
  7. 7.
    Okatani, T., Deguchi, K.: Projector-screen-camera system: Theory and algorithm for screen-to-camera homography estimation. In: Proc. International Conference on Computer Vision (2003)Google Scholar
  8. 8.
    Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000)zbMATHGoogle Scholar
  9. 9.
    Libstroke - a stroke translation library,

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Akash Kushal
    • 1
  • Jeroen van Baar
    • 2
  • Ramesh Raskar
    • 2
  • Paul Beardsley
    • 2
  1. 1.Department of Computer ScienceUniversity of IllinoisUrbana ChampaignUSA
  2. 2.Mitsubishi Electric Research LaboratoriesUSA

Personalised recommendations