VIEWs: Visual Interaction Enriched Windows

  • Jean-Bernard Martens
  • Dzmitry Aliakseyeu
  • Jan-Roelof de Pijper
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3295)


We discuss how an augmented-reality platform can be used as a transparent interface to a windows environment. The resulting Visual Interaction Enriched Windows (VIEWs) intend to realize an evolutionary rather than a revolutionary transition from the classical desktop environment to an augmented-reality (AR) environment. Therefore, in VIEWs, windows applications can still be controlled by standard means, i.e., by using mouse and keyboard. In this way, acquired user skills with existing windows applications can still be exploited. The additional interaction styles that are offered by the AR platform, including two-handed interaction, pen input with in-place visual feedback, and transparency, may however be used to improve specific interactions, such as sketching and handwriting, that are more difficult to perform on a classical desktop. The user is free at all times to choose the interaction style that best suits his/her needs when performing specific operations. The VIEWs concept has been implemented as part of an existing AR tool for designers.


Visual Feedback Augmented Reality Interaction Style Electronic Paper Communication Space 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kurtenbach, G., Fitzmaurice, G., Baudel, T., Buxton, B.: The design of a gui paradigm based on tablets, two-hands, and transparency. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 35–42. ACM Press, New York (1997)CrossRefGoogle Scholar
  2. 2.
    Fitzmaurice, G.W., Ishii, H., Buxton, W.A.S.: Bricks: laying the foundations for graspable user interfaces. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 442–449. ACM Press/Addison-Wesley Publishing Co. (1995)Google Scholar
  3. 3.
    Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. IBM Systems Journal, 915–931 (2000)Google Scholar
  4. 4.
    Rauterberg, M., Steiger, P.: Pattern recognition as a key technology for the next generation of user interfaces. In: 1996 IEEE International Conference on Systems, Man and Cybernetics, pp. 2805–2810 (1996)Google Scholar
  5. 5.
    Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Transactions on Information Systems, 1321–1329 (1994)Google Scholar
  6. 6.
    Benford, S., Greenhalgh, C., Reynard, G., Brown, C., Koleva, B.: Understanding and constructing shared spaces with mixed-reality boundaries. ACM Trans. Comput.-Hum. Interact. 5, 185–223 (1998)CrossRefGoogle Scholar
  7. 7.
    Billinghurst, M., Kato, H., Poupyrev, I.: The magicbook: A transitional ar interface. Computers & Graphics 25, 745–753 (2001)CrossRefGoogle Scholar
  8. 8.
    Ishii, H., Kobayashi, M.: Clearboard: a seamless medium for shared drawing and conversation with eye contact. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 525–532. ACM Press, New York (1992)Google Scholar
  9. 9.
    Wellner, P.: Interacting with paper on the digitaldesk. Commun. ACM 36, 87–96 (1993)CrossRefGoogle Scholar
  10. 10.
    Stafford-Fraser, Q., Robinson, P.: Brightboard: a video-augmented environment. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 134–141. ACM Press, New York (1996)Google Scholar
  11. 11.
    Rauterberg, M., Bichsel, M., Meier, M., Fjeld, M.: A gesture based interaction technique for a planning tool for construction and design. In: Proceedings of the 6th IEEE International Workshop on Robot and Human Communication, pp. 212–217 (1997)Google Scholar
  12. 12.
    Robinson, J.A., Robertson, C.: The livepaper system: Augmenting paper on an enhanced tabletop. Computers & Graphics 25, 731–743 (2001)CrossRefGoogle Scholar
  13. 13.
    Aliakseyeu, D., Martens, J.B., Subramanian, S., Vroubel, M., Wesselink, W.: Visual interaction platform. In: Proceedings of Interact 2001, pp. 232–239 (2001)Google Scholar
  14. 14.
    Billinghurst, M., Kato, H.: Collaborative augmented reality. Commun. ACM 45, 64–70 (2002)CrossRefGoogle Scholar
  15. 15.
    Buxton, B., Billinghurst, M., Guiard, Y., Sellen, A., Zhai, S.: Human Input to Computer Systems: Theories, Techniques and Technology (2002) (unpublished), see
  16. 16.
    Weiser, M.: The computer for the twenty-first century. Scientific American, 94–104 (1991)Google Scholar
  17. 17.
    Weiser, M.: Some computer science issues in ubiquitous computing. Commun. ACM 36, 75–84 (1993)CrossRefGoogle Scholar
  18. 18.
    Regenbrecht, H., Baratoff, G., Wagner, M.: A tangible ar desktop environment. Computers & Graphics 25, 755–763 (2001)CrossRefGoogle Scholar
  19. 19.
    Aliakseyeu, D.: A Computer Support Tool for the Early Stages of Architectural Design. PhD thesis, Eindhoven University of Technology (2003)Google Scholar
  20. 20.
    Woo, M., Neider, J., Davis, T., Shreiner, D.: OpenGL Programming Guide. Addison-Wesley, Reading (1999)Google Scholar
  21. 21.
    Wellner, P., Mackay, W., Gold, R.: Back to the real world. Commun. ACM 36, 24–27 (1993)CrossRefGoogle Scholar
  22. 22.
    Newman, W., Wellner, P.: A desk supporting computer-based interaction with paper documents. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 587–592. ACM Press, New York (1992)Google Scholar
  23. 23.
    Mackay, W., Velay, G., Carter, K., Ma, C., Pagani, D.: Augmenting reality: adding computational dimensions to paper. Commun. ACM 36, 96–97 (1993)CrossRefGoogle Scholar
  24. 24.
    Mackay, W.E., Pagani, D.S., Faber, L., Inwood, B., Launiainen, P., Brenta, L., Pouzol, V.: Ariel: augmenting paper engineering drawings. In: Conference companion on Human factors in computing systems, pp. 421–422. ACM Press, New York (1995)CrossRefGoogle Scholar
  25. 25.
    Mackay, W.E.: Augmented reality: linking real and virtual worlds: a new paradigm for interacting with computers. In: Proceedings of the working conference on Advanced visual interfaces, pp. 13–21. ACM Press, New York (1998)CrossRefGoogle Scholar
  26. 26.
    Fish, J., Scrivener, S.: Amplifying the mind’s eye: Sketching and visual cognition. Leonardo, 117–126 (1990)Google Scholar
  27. 27.
    Trinder, M.: The computer’s role in sketch design: A transparent sketching medium. In: Proceedings of the 8th International Conference on Computer Aided Architectural Design Futures, pp. 227–244 (2000)Google Scholar
  28. 28.
    Landay, J., Myers, B.: Sketching interfaces: Toward more human interface design. IEEE Computer, 56–64 (2001)Google Scholar
  29. 29.
    Fitzmaurice, G.W., Balakrishnan, R., Kurtenbach, G., Buxton, B.: An exploration into supporting artwork orientation in the user interface. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 167–174. ACM Press, New York (1999)Google Scholar
  30. 30.
    Rekimoto, J.: Pick-and-drop: A direct manipulation technique for multiple computer environments. In: Proceedings of UIST 1997 Banff, pp. 31–39. ACM Press, New York (1997)Google Scholar
  31. 31.
    Bier, E.A., Stone, M.C., Pier, K., Buxton, W., DeRose, T.D.: Toolglass and magic lenses: the see-through interface. In: Proceedings of the 20th annual conference on Computer graphics and interactive techniques, pp. 73–80. ACM Press, New York (1993)CrossRefGoogle Scholar
  32. 32.
    Bier, E., Stone, M., Pier, K.: Enhanced illustration using magic lens filters. IEEE Computer Graphics and Application, 62–70 (1997)Google Scholar
  33. 33.
    Rekimoto, J., Sciammarella, E.: Toolstone: effective use of the physical manipulation vocabularies of input devices. In: Proceedings of the 13th annual ACM symposium on User interface software and technology, pp. 109–117. ACM Press, New York (2000)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Jean-Bernard Martens
    • 1
  • Dzmitry Aliakseyeu
    • 1
  • Jan-Roelof de Pijper
    • 1
  1. 1.Department of Industrial DesignEindhoven University of TechnologyEindhoventhe Netherlands

Personalised recommendations