Context-Sensitive Display Environments

  • Florian DaiberEmail author
  • Antonio Krüger
  • Johannes Schöning
  • Jörg Müller
Part of the Cognitive Technologies book series (COGTECH)


In this chapter we will discuss the relatively new research area of context-sensitive Displays. The cheap availability of display spaces in combination with sensor technologies which allows to make inferences about the context of the display will enable a multitude of novel applications. However the foundations of these sensor-display systems are not well understood. Therefore we will discuss in this chapter the basic setup and a research methodology which has helped us to systematically approach the problems we faced during the design of several context-sensitive display environments. For this purpose we will present three research systems: the iDisplay-system, a public information system which uses extensively context-filtered information to inform students in University buildings, the MobiDic-system an context-sensitive advertisement management system for digital outdoor signage and our research on the Münster Multitouch Wall, which demonstrates novel ways of interacting with large displays in public environments.


Mobile Device Virtual Object Spatial Object Public Display Virtual Globe 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Alvarado, C., Davis, R.: SketchREAD: A Multi-Domain Sketch Recognition Engine. In: Proceedings of UIST 2004. pp. 23–32. ACM (2004)Google Scholar
  2. 2.
    BBK (Bundesamt für Bevölkerungsschutz und Katastrophenhilfe): deNIS IIplus – Rechnergestütztes Krisenmanagement bei Bund und Ländern. (2006)Google Scholar
  3. 3.
    Brignull, H., Rogers, Y.: Enticing people to interact with large public displays in public spaces. In: Proceedings of INTERACT ‘03. pp. 17–24 (2003)Google Scholar
  4. 4.
    Carver, L., Turoff, M.: Human-computer interaction: the human and computer as a team in emergency management information systems. Commun. ACM 50, 33–38 (March 2007)CrossRefGoogle Scholar
  5. 5.
    Daiber, F., Schöning, J., Krüger, A.: Whole Body Interaction with Geospatial Data. In: Butz, A., Fisher, B., Christie, M. (eds.) Smart Graphics. vol. 5531, pp. 81–92. Springer (2009)Google Scholar
  6. 6.
    Davis, R.: Sketch Understanding in Design: Overview of Work at the MIT AI Lab. In: Sketch Understanding, Papers from the 2002 AAAI Spring Symposium. pp. 24–31. AAAI Press (2002)Google Scholar
  7. 7.
    Elrod, S., Bruce, R., Gold, R., Goldberg, D., Halasz, F., Janssen, W., Lee, D., Mc-Call, K., Pedersen, E., Pier, K., Tang, J., Welch, B.: Liveboard: a large interactive display supporting group meetings, presentations, and remote collaboration. In: CHI ‘92: Proceedings of the SIGCHI conference on Human factors in computing systems. pp. 599–607. ACM (1992)Google Scholar
  8. 8.
    Florence, J., Hornsby, K., Egenhofer, M.: The GIS wallboard: interactions with spatial information on large-scale displays. International Symposium on Spatial Data Handling 7, 449–463 (1996)Google Scholar
  9. 9.
    Greenberg, S., Buxton, B.: Usability evaluation considered harmful (some of the time). In: CHI ‘08: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems. pp. 111–120. ACM (2008)Google Scholar
  10. 10.
    Hecht, B.: Wikeye – using magic lenses to explore georeferenced wikipedia content. In: PERMID ‘07: Proceedings of the 3rd International Workshop on Pervasive Mobile Interaction Devices (2007)Google Scholar
  11. 11.
    Hornecker, E.: “I don’t understand it either, but it is cool” – Visitor Interactions with a Multi-Touch Table in a Museum. In: TABLETOP ‘08: 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems. pp. 113–120 (2008)Google Scholar
  12. 12.
    Jankowicz, D.: The Easy Guide to Repertory Grids. Wiley (2003)Google Scholar
  13. 13.
    Krumm, J., Hinckley, K.: The nearme wireless proximity server. In: Davies, N., Mynatt, E., Siio, I. (eds.) UbiComp ‘04: Ubiquitous Computing, Lecture Notes in Computer Science, vol. 3205, pp. 283–300. Springer (2004)Google Scholar
  14. 14.
    Löchtefeld, M., Schöning, J., Rohs, M., Krüger, A.: LittleProjectedPlanet: An Augmented Reality Game for Camera Projector Phones. In: MIRW ‘09: Workshop on Mobile Interaction with the Real World (at MobileHCI 2009) (2009)Google Scholar
  15. 15.
    Maceachren, A.M., Brewer, I., Cai, G., Chen, J.: Visually-enabled geocollaboration to support dataexploration decision-making. In: Proceedings of the 21st International Cartography Conference. pp. 394–401 (2003)Google Scholar
  16. 16.
    Mitchell, T.: Machine Learning. McGraw-Hill Education (ISE Editions) (1997)Google Scholar
  17. 17.
    Müller, H.J., Krüger, A.: Learning topologies of situated public displays by observing implicit user interactions. In: UAHCI’07: Proceedings of the 4th international conference on Universal access in human-computer interaction: ambient interaction. pp. 158–167. Springer (2007)Google Scholar
  18. 18.
    Müller, J., Jentsch, M., Kray, C., Krüger, A.: Exploring factors that influence the combined use of mobile devices and public displays for pedestrian navigation. In: NordiCHI ‘08: Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges. pp. 308–317. ACM (2008)Google Scholar
  19. 19.
    Müller, J., Krüger, A.: Mobidic: Context adaptive digital signage with coupons. In: AmI ‘09: Proceedings of the European Conference on Ambient Intelligence. pp. 24–33. Springer (2009)Google Scholar
  20. 20.
    Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., Oulasvirta, A., Saarikko, P.: It’s mine, don’t touch!: interactions at a large multi-touch display in a city centre. In: CHI ‘08: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems. pp. 1285–1294. ACM (2008)Google Scholar
  21. 21.
    Prante, T., Röcker, C., Streitz, N., Stenzel, R., Magerkurth, C.: Hello.wall – beyond ambient displays. In: Ubicomp ‘03: In Adjunct Proceedings of Ubicomp. pp. 277–278 (2003)Google Scholar
  22. 22.
    Rohs, M., Schöning, J., Raubal, M., Essl, G., Krüger, A.: Map navigation with mobile devices: virtual versus physical movement with and without visual context. In: ICMI ‘07: Proceedings of the 9th international conference on Multimodal interfaces. pp. 146–153. ACM (2007)Google Scholar
  23. 23.
    Ryall, K., Forlines, C., Shen, C., Morris, M.R., Everitt, K.: Experiences with and observations of direct-touch tabletops. In: TABLETOP ‘06: Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems. pp. 89–96. IEEE (2006)Google Scholar
  24. 24.
    Schöning, J., Brandl, P., Daiber, F., Echtler, F., Hilliges, O., Hook, J., Löchtefeld, M., Motamedi, N., Muller, L., Olivier, P., Roth, T., von Zadow, U.: Multi-touch surfaces: A technical guide. Tech. rep., University of Munich (2008)Google Scholar
  25. 25.
    Schöning, J., Hecht, B., Raubal, M., Krüger, A., Marsh, M., Rohs, M.: Improving Interaction with Virtual Globes through Spatial Thinking: Helping users Ask “Why?”. In: IUI ‘08: Proceedings of the 13th annual ACM conference on Intelligent User Interfaces. ACM, USA (2008)Google Scholar
  26. 26.
    Schöning, J., Krüger, A., Cheverst, K., Rohs, M., Löchtefeld, M., Taher, F.: Photomap: using spontaneously taken images of public maps for pedestrian navigation tasks on mobile devices. In: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services. pp. 14:1–14:10. MobileHCI ‘09, ACM, New York, NY, USA (2009)Google Scholar
  27. 27.
    UNIGIS. Guidelines for Best Practice in User Interface for GIS: ESPRIT/ESSI project no. 21580 (1998)Google Scholar
  28. 28.
    Usländer, T. (ed.): Reference Model for ORCHESTRA Architecture V2, Project Deliverable. Orchestra Consortium (2007)Google Scholar
  29. 29.
    Vogel, D., Balakrishnan, R.: Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In: UIST ‘04: Proceedings of the 17th annual ACM symposium on User interface software and technology. pp. 137–146. ACM (2004)Google Scholar
  30. 30.
    Wasinger, R., Stahl, C., Krüger, A.: M3I in a Pedestrian Navigation & Exploration System. In: MobileHCI ‘03: Proceedings of the 5th International Symposium on Human-Computer Interaction With Mobile Devices and Services. Springer (2003)Google Scholar
  31. 31.
    Weiser, A., Neis, P., Zipf, A.: Orchestrierung von OGC Web Diensten im Katastrophenmanagement – am Beispiel eines Emergency Route Service auf Basis der OpenLS Spezifikation. In: GIS – Zeitschrift für Geoinformatik. pp. 35–41 (2006)Google Scholar
  32. 32.
    Weiser, M.: The computer for the 21st century. Scientific American 3(3), 94–104 (1991)CrossRefGoogle Scholar
  33. 33.
    Weiser, M., Gold, R., Brown, J.S.: The origins of ubiquitous computing research at PARC in the late 1980s. IBM Syst. J. 38, 693–696 (1999)CrossRefGoogle Scholar
  34. 34.
    Weiser, M.: The computer for the 21st century. In: Baecker, R.M., Grudin, J., Buxton, W.A.S., Greenberg, S. (eds.) Human-computer interaction, pp. 933–940. Morgan Kaufmann (1995)Google Scholar
  35. 35.
    Wilson, A.D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., Kirk, D.: Bringing physics to the surface. In: UIST ‘08: Proceedings of the 21st annual ACM symposium on User interface software and technology. pp. 67–76. ACM (2008)Google Scholar
  36. 36.
    Wobbrock, J.O., Morris, M.R., Wilson, A.D.: User-defined gestures for surface computing. In: CHI ‘09: Proceedings of the 27th international conference on Human factors in computing systems. pp. 1083–1092. ACM (2009)Google Scholar
  37. 37.
    Wu, M., Balakrishnan, R.: Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. UIST ‘03: Proceedings of the 16th annual ACM symposium on User interface software and technology pp. 193–202 (2003)Google Scholar
  38. 38.
    Wu, M., Shen, C., Ryall, K., Forlines, C., Balakrishnan, R.: Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces. In: TABLETOP ‘06: Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems. pp. 185–192. IEEE (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Florian Daiber
    • 1
    Email author
  • Antonio Krüger
    • 1
  • Johannes Schöning
    • 1
  • Jörg Müller
    • 2
  1. 1.Innovative Retail LabGerman Research Institute for Artificial Intelligence (DFKI)SaarbrückenGermany
  2. 2.Deutsche Telekom LaboratoriesTU BerlinBerlinGermany

Personalised recommendations