Input and Display of Hand Drawn Pattern Onto Planar Board of Arbitrary Position and Pose Utilizing a Projector and Two Cameras

  • Hideo Saito
  • Hitoshi Ban
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3617)


In this paper, we propose a system for inputting hand drawn pattern and displaying it on a hand-held planar rectangle board by utilizing two cameras and a projector which are installed above the user. In this system, the cameras and the projector are related by projective geometry. The cameras capture the user’s hand-drawing motion. From the captured images, the tip of the user’s pen and the corners of the board are tracked for detecting the status of pen’s up/down and displaying the drawn pattern at a fixed position on the surface of the board. For demonstrating the validity of the proposed system, we show that the user can draw pattern on the board with arbitrary pose and position, while the pattern is simultaneously displayed on the board in real-time.


  1. 1.
  2. 2.
  3. 3.
    Yamasaki, T., Hattori, T.: A New Data Tablet System for Handwriting Characters and Drawing Based on Image Processing. In: Proc. IEEE Int. Conf. Systems, Man and Cybernetics, pp. 428–431 (1996)Google Scholar
  4. 4.
    Bunke, H., Von Siebenhal, T., Yamasaki, T., Schenkel, M.: Online Handwriting Data Acquisition Using Video Camera. In: Proc. Int. Conf. Document Analysis and Recognition, pp. 573–576 (1999)Google Scholar
  5. 5.
    Nabeshima, S., Yamamoto, S., Agusa, K., Taguchi, T.: Memo-Pen: A New Input Device. In: Proc. Int. Conf. Human Factors in Computing Systems(CHI), pp. 256–257 (1995)Google Scholar
  6. 6.
    Munich, M.E., Perona, P.: Visual Input for Pen-Based Computers. IEEE Trans. Pattern Analysis and Machine Intelligence 24, 313–328 (2002)CrossRefGoogle Scholar
  7. 7.
    Zhang, Z., Wu, Y., Shan, Y., Shafer, S.: Visual panel: Virtual mouse keyboard and 3d controller with an ordinary piece of paper. In: Proc. of ACM Workshop on Perceptive User Interfaces (PUI) (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Hideo Saito
    • 1
  • Hitoshi Ban
    • 1
  1. 1.Department of Information and Computer ScienceKeio UniversityYokohamaJapan

Personalised recommendations