NUI-Based Floor Navigation — A Case Study

  • Ulrich Furbach
  • Markus Maron
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8014)


In this paper, we describe a nui-based application using a Microsoft Kinect. The system displays a digital representation of a university building, where users can navigate virtually through contact-less gestures. Users can step up and couple their hand with a virtual mouse cursor to navigate through the program such that hand movements to the right lead to cursor movements to the right for example. We present an evaluation of the system, which is based on a 100’ day operation by logging 2.000 user sessions.


Gesture Recognition User Session Public Display Virtual Hand Contact Data 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Gallo, L., Placitelli, A.P., Ciampi, M.: Controller-free exploration of medical image data: Experiencing the Kinect. In: CBMS, pp. 1–6. IEEE (2011)Google Scholar
  2. 2.
    Goth, G.: Brave NUI world. Commun. ACM 54, 14–16 (2011), CrossRefGoogle Scholar
  3. 3.
    Huang, E.M., Koster, A., Borchers, J.: Overcoming assumptions and uncovering practices: When does the public really look at public displays? In: Indulska, J., Patterson, D.J., Rodden, T., Ott, M. (eds.) PERVASIVE 2008. LNCS, vol. 5013, pp. 228–243. Springer, Heidelberg (2008), CrossRefGoogle Scholar
  4. 4.
    Jacucci, G., Morrison, A., Richard, G.T., Kleimola, J., Peltonen, P., Parisi, L., Laitinen, T.: Worlds of information: designing for engagement at a public multi-touch display. In: Mynatt, E.D., Schoner, D., Fitzpatrick, G., Hudson, S.E., Edwards, W.K., Rodden, T. (eds.) CHI, pp. 2267–2276. ACM (2010)Google Scholar
  5. 5.
    Michelis, D.: Interaktive Großbildschirme im öffentlichen Raum: Nutzungsmotive und Gestaltungsregeln. Gabler Edition Wissenschaft, Gabler Verlag (2009),
  6. 6.
    Microsoft Kinect, (last accessed on February 26, 2013)
  7. 7.
    Moretti, S.: Doctors use Xbox Kinect in cancer surgery (March 2011), (last accessed on February 26, 2013)
  8. 8.
    Müller, J., Walter, R., Bailly, G., Nischt, M., Alt, F.: Looking glass: a field study on noticing interactivity of a shop window. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2012, pp. 297–306. ACM, New York (2012), Google Scholar
  9. 9.
    Müller, J., Walter, R., Bailly, G., Nischt, M., Alt, F.: Looking glass: a field study on noticing interactivity of a shop window. In: Konstan, J.A., Chi, E.H., Höök, K. (eds.) CHI, pp. 297–306. ACM (2012)Google Scholar
  10. 10.
    OpenNI - The standard framwork for 3D sensing, (last accessed on February 26, 2013)
  11. 11.
    Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., Oulasvirta, A., Saarikko, P.: It’s mine, don’t touch!: interactions at a large multi-touch display in a city centre. In: Proceedings of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, CHI 2008, pp. 1285–1294. ACM, New York (2008), CrossRefGoogle Scholar
  12. 12.
    PrimeSensorTM Reference Design, (last accessed on February 26, 2013)
  13. 13.
    Shneiderman, B.: Designing for fun: how can we design user interfaces to be more fun? Interactions 11(5), 48–50 (2004)CrossRefGoogle Scholar
  14. 14.
    Triesch, J., von der Malsburg, C.: Robotic gesture recognition. In: Wachsmuth, I., Fröhlich, M. (eds.) GW 1997. LNCS (LNAI), vol. 1371, pp. 233–244. Springer, Heidelberg (1998)CrossRefGoogle Scholar
  15. 15.
    Wall, J.: Kinect and Medical Imaging, (last accessed on February 26, 2013)

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Ulrich Furbach
    • 1
  • Markus Maron
    • 1
  1. 1.Department of Computer Science, Artificial Intelligence Research GroupUniversity of Koblenz-LandauKoblenzGermany

Personalised recommendations