Spatial Control of Interactive Surfaces in an Augmented Environment

  • Stanislaw Borkowski
  • Julien Letessier
  • James L. Crowley
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3425)


New display technologies will enable designers to use every surface as a support for interaction with information technology. In this article, we describe techniques and tools for enabling efficient man-machine interaction in computer augmented multi-surface environments. We focus on explicit interaction, in which the user decides when and where to interact with the system. We present three interaction techniques using simple actuators: fingers, a laser pointer, and a rectangular piece of cardboard. We describe a graphical control interface constructed from an automatically generated and maintained environment model. We implement both the automatic model acquisition and the interaction techniques using a Steerable Camera-Projector (SCP) system.


Environment Model Interaction Technique Display Surface Laser Pointer Spatial Control 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bérard, F.: The magic table: Computer-vision based augmentation of a whiteboard for creative meetings. In: Proceedings of the ICCV Workshop on Projector-Camera Systems. IEEE Computer Society Press, Los Alamitos (2003)Google Scholar
  2. 2.
    Borkowski, S., Riff, O., Crowley, J.L.: Projecting rectified images in an augmented environment. In: Proceedings of the ICCV Workshop on Projector-Camera Systems. IEEE Computer Society Press, Los Alamitos (2003)Google Scholar
  3. 3.
    Brumitt, B., Meyers, B., Krumm, J., Kern, A., Shafer, S.: Easyliving: Technologies for intelligent environments. In: Proceedings of Handheld and Ubiquitous Computing (September 2000)Google Scholar
  4. 4.
    Davis, J., Chen, X.: Lumipoint: Multi-user laser-based interaction on large tiled displays. Displays 23(5) (2002)Google Scholar
  5. 5.
    Raskar, R., et al.: iLamps: Geometrically aware and self-configuring projectors. In: Appears ACM SIGGRAPH 2003 Conference Proceedings (2003)Google Scholar
  6. 6.
    Hungy, Y.-P., Yangz, Y.-S., Cheny, Y.-S., Hsiehz, I.-B., Fuhz, C.-S.: Free-hand pointer by use of an active stereo vision system. In: Proceedings of the 14th International Conference on Pattern Recognition (ICPR 1998), vol. 2, pp. 1244–1246 (August 1998)Google Scholar
  7. 7.
    Coutaz, J., Lachenal, C., Dupuy-Chessa, S.: Ontology for multi-surface interaction. In: Proceedings of the ninth International Conference on Human-Computer Interaction, Interact’2003 (2003)Google Scholar
  8. 8.
    Johanson, B., Hutchins, G., Winograd, T., Stone, M.: Pointright: Experience with flexible input redirection in interactive workspaces. In: Proceedings of UIST-2002 (2002)Google Scholar
  9. 9.
    Olsen Jr., D.R., Nielsen, T.: Laser pointer interaction. In: ACM CHI’2001 Conference Proceedings: Human Factors in Computing Systems, Seattle, WA (2001)Google Scholar
  10. 10.
    Meyers, B.A., Bhatnagar, R., Nichols, J., Peck, C.H., Kong, D., Miller, R., Long, A.C.: Interacting at a distance: measuring the performance of laser pointers and other devices. In: Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves. ACM Press, New York (April 2002)Google Scholar
  11. 11.
    Pingali, G., Pinhanez, C., Levas, A., Kjeldsen, R., Podlaseck, M., Chen, H., Sukaviriya, N.: Steerable interfaces for pervasive computing spaces. In: Proceedings of IEEE International Conference on Pervasive Computing and Communications - PerCom 2003 (March 2003)Google Scholar
  12. 12.
    Pinhanez, C.: The everywhere displays projector: A device to create ubiquitous graphical interfaces. In: Proceedings of Ubiquitous Computing 2001 Conference (September 2001)Google Scholar
  13. 13.
    Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., Fuchs, H.: The office of the future: A unified approach to image-based modeling and spatially immersive displays. In: Proceedings of the ACM SIGGRAPH 1998 Conference (1998)Google Scholar
  14. 14.
    Rekimoto, J.: Multiple-computer user interfaces: “beyond the desktop” direct manipulation environments. In: ACM CHI 2000 Video Proceedings (2000)Google Scholar
  15. 15.
    Rekimoto, J., Saitoh, M.: Augmented surfaces: A spatially continuous workspace for hybrid computing environments. In: Proceedings of CHI 1999, pp. 378–385 (1999)Google Scholar
  16. 16.
    Roeber, H., Bacus, J., Tomasi, C.: Typing in thin air: the canesta projection keyboard - a new method of interaction with electronic devices. In: CHI 2003 extended abstracts on Human factors in computing systems, pp. 712–713. ACM Press, New York (2003)CrossRefGoogle Scholar
  17. 17.
    Streitz, N.A., Geißler, J., Holmer, T., Konomi, S., Müller-Tomfelde, C., Reischl, W., Rexroth, P., Seitz, P., Steinmetz, R.: i-land: An interactive landscape for creativitiy and innovation. In: ACM Conference on Human Factors in Computing Systems (1999)Google Scholar
  18. 18.
    Streitz, N.A., Röcker, C., Prante, T., Stenzel, R., van Alphen, D.: Situated interaction with ambient information: Facilitating awareness and communication in ubiquitous work environments. In: Tenth International Conference on Human-Computer Interaction (June 2003)Google Scholar
  19. 19.
    Szalavári, Z., Gervautz, M.: The personal interaction panel - a two-handed interface for augmented reality. In: Proceedings of EUROGRAPHICS 1997, Budapest, Hungary (September 1997)Google Scholar
  20. 20.
    Takao, N., Shi, J., Baker, S.: Tele-graffiti: A camera-projector based remote sketching system with hand-based user interface and automatic session summarization. International Journal of Computer Vision 53(2), 115–133 (2003)CrossRefGoogle Scholar
  21. 21.
    Underkofflerand, J., Ullmer, B., Ishii, H.: Emancipated pixels: Real-world graphics in the luminous room. In: Proceedings of ACM SIGGRAPH, pp. 385–392 (1999)Google Scholar
  22. 22.
    Vernier, F., Lesh, N., Shen, C.: Visualization techniques for circular tabletop interfaces. In: Advanced Visual Interfaces (2002)Google Scholar
  23. 23.
    Voida, S.A., Mynatt, E.D., MacIntyre, B., Corso, G.: Integrating virtual and physical context to support knowledge workers. In: Proceedings of Pervasive Computing Conference. IEEE Computer Society Press, Los Alamitos (2002)Google Scholar
  24. 24.
    Wellner, P.: The digitaldesk calculator: Tactile manipulation on a desk top display. In: ACM Symposium on User Interface Software and Technology, pp. 27–33 (1991)Google Scholar
  25. 25.
    Yang, R., Welch, G.: Automatic and continuous projector display surface calibration using every-day imagery. In: CECG 2001 (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Stanislaw Borkowski
    • 1
  • Julien Letessier
    • 1
  • James L. Crowley
    • 1
  1. 1.Project PRIMA, Lab. GRAVIR-IMAGINRIA Rhône-AlpesMontbonnotFrance

Personalised recommendations