To Frame or Not to Frame: The Role and Design of Frameless Displays in Ubiquitous Applications

  • Claudio Pinhanez
  • Mark Podlaseck
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3660)


A frameless display is a display with no perceptible boundaries; it appears to be embodied in the physical world. Frameless displays are created by projecting visual elements on a black background into a physical environment. By considering visual arts and design theory together with our own experience building about a dozen applications, we argue the importance of this technique in creating ubiquitous computer applications that are truly contextualized in the physical world. Nine different examples using frameless displays are described, providing the background for a systematization of frameless displays pros and cons, together with a basic set of usage guidelines. The paper also discusses the differences and constraints on user interaction with visual elements in a frameless display.


Ubiquitous Computing Visual Design Comic Book Visual Element Picture Frame 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Anderson, L.: Empty Places. Harper Perennial. New York (1991)Google Scholar
  2. 2.
    Butz, A., et al.: SearchLight - A Lightweight Search Function for Pervasive Environments. In: Proceedings of Pervasive 2004. Vienna, Austria, April 21-23, pp. 351–356 (2004)Google Scholar
  3. 3.
    Chikamori, M., Kunoh, K.: KAGE. In: SIGGRAPH 1998 Electronic Art and Animation Catalog. Orlando, Florida, July 19-24, vol. 14 (1998)Google Scholar
  4. 4.
    Dourish, P.: Where the Action is: the Foundations of Embodied Interaction. MIT Press. Cambridge (2001)Google Scholar
  5. 5.
    Duncker, K.: On Problem Solving. Psychological Monographs 270 (1945)Google Scholar
  6. 6.
    Duro, P.: The Rhetoric of the Frame: Essays on the Boundaries of the Artwork. Cambridge University Press, Cambridge (1996)Google Scholar
  7. 7.
    Eisner, W.: Comics & Sequential Art. Poorhouse Press. Guerneville (1985) Google Scholar
  8. 8.
    Hall, P.: Starting Small. Metropolis ( (2004),
  9. 9.
    Henger, S., Kosenko, P.: Chris Burden: A Twenty Year Survey. Newport Harber Art Musuem (1988)Google Scholar
  10. 10.
    Hoffman, D.: Visual Intelligence: How We Create What We See. W. W. Norton,New York (1998)Google Scholar
  11. 11.
    Intille, S., et al.: Ubiquitous Computing in the Living Room, Concept Sketches and an Implementation of a Persistent User Interface. In: Dey, A.K., Schmidt, A., McCarthy, J.F. (eds.) UbiComp 2003. LNCS, vol. 2864, Springer, Heidelberg (2003)Google Scholar
  12. 12.
    Iwai, T.: Composition on the Table. In: SIGGRAPH 1999 Electronic Art and Computer Animation Catalog. Los Angeles, California, August, 8-13, vol. 10 (1999)Google Scholar
  13. 13.
    Kaprow, A., Kelley, J.: Essays on the Blurring of Art and Life. University of California Press. Berkeley (1993)Google Scholar
  14. 14.
    Krueger, M.W.: Artificial Reality II. Addison-Wesley, Reading (1990)Google Scholar
  15. 15.
    McCloud, S.: Understanding Comics. Kitchen Sink Press. Northampton (1993)Google Scholar
  16. 16.
    Meister, J.C.: The Metalepticon: a Computational Approach to Metalepsis. Universität Hamburg. September 3 (2003),
  17. 17.
    Morton, A.: A New Frame of Mind. International Institute for Frame Study. February 26 (2000),
  18. 18.
    Murata, K., Yamauchi, E.: Fisherman’s Cafe. In: SIGGRAPH 1999 Electronic Art and Computer Animation Catalog. Los Angeles, California, August 8-13, vol. 12 (1999)Google Scholar
  19. 19.
    : Less About Appearances. Skeptical Inquirer, 1–2 (2003)Google Scholar
  20. 20.
    Pinhanez, C.: The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) UbiComp 2001. LNCS, vol. 2201, p. 315. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  21. 21.
    Pinhanez, C., et al.: Ubiquitous Interactive Graphics. IBM Research Report RC22495 (W0205-143), May 17 (2002)Google Scholar
  22. 22.
    Podlaseck, M., et al.: On Interfaces Projected onto Real-World Objects. In: Proc. of CHI 2003 (short papers). Fort Lauderdale, Florida, April 5-10 (2003)Google Scholar
  23. 23.
    Raskar, R., et al.: RFIG Lamps: Interacting With a Self-Describing World via Photosensing Wireless Tags and Projectors. In: Proc. of SIGGRAPH 2004. Los Angeles, California, August 8-12 (2004)Google Scholar
  24. 24.
    Raskar, R., et al.: iLamps: Geometrically Aware and Self-Configuring Projectors. In: Proc. of SIGGRAPH 2003. San Diego, California, July 27-31, pp. 809–818 (2003)Google Scholar
  25. 25.
    Rekimoto, J.: A Multiple Device Approach for Supporting Whiteboard-based Interactions. In: Proc. of CHI 1998, Los Angeles, California, April 18-23, pp. 344–351 (1998)Google Scholar
  26. 26.
    Rekimoto, J., Saitoh, M.: Augmented Surfaces: A Spatially Continuous Workplace for Hybrid Computing Environments. In: Proc. of CHI 1999. Pittsburgh, Pennsylvania, May 15- 20, pp. 378–385 (1999)Google Scholar
  27. 27.
    Shen, C., et al.: DiamondSpin: An Extensible Toolkit for Around-the-Table Interaction. In: Proc. of CHI 2004, April 2004, pp. 167–174 (2004)Google Scholar
  28. 28.
    Small, D., White, T.: Stream of Consciouness. In: SIGGRAPH 1998 Electronic Art and Animation Catalog. Orlando, Florida, July 19-24, vol. 50 (1998)Google Scholar
  29. 29.
    Sukaviriya, N., et al.: Embedding Interactions in a Retail Store Environment: The Design and Lessons Learned. In: Proc. of the Ninth IFIP International Conference on Human- Computer Interaction (INTERACT 2003). Zurich, Switzerland, September 2003, pp. 1–5 (2003)Google Scholar
  30. 30.
    Underkoffler, J., et al.: Emancipated Pixels: Real-World Graphics in the Luminous Room. In: Proc. of SIGGRAPH 1999. Los Angeles, California, August 8-13, pp. 385–392 (1999)Google Scholar
  31. 31.
    Wasinger, R., et al.: Integrating Intra and Extra Gestures into a Mobile and Multimodal Shopping Assistant. In: Proc. of the 3rd International Conference on Pervasive Computing, Munich, Germany, May 8-13, pp. 297–314 (2005)Google Scholar
  32. 32.
    Weiser, M.: The Computer for the Twenty-First Century. Scientific American 265(3), 94–100 (1991)CrossRefGoogle Scholar
  33. 33.
    Wellner, P.: Interacting with Paper on the DigitalDesk. Communications of the ACM 36(7) (1993)Google Scholar
  34. 34.
    Wineski, C., et al.: PingPongPlus: Augmentation and Transformation of Athletic Interpersonal Interaction. In: Proc. of CHI 1998. Los Angeles, California, pp. 327–328 (1998)Google Scholar
  35. 35.
    Yotsukura, T., et al.: Hypermask - Projecting a Talking Head onto a Real Object. The Visual Computer 18(2), 111–120 (2002)zbMATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Claudio Pinhanez
    • 1
  • Mark Podlaseck
    • 1
  1. 1.IBM Research, T.J. WatsonHawthorneUSA

Personalised recommendations