Seeing through the Kinect: A Survey on Heuristics for Building Natural User Interfaces Environments

  • Vanessa Regina Margareth Lima Maike
  • Laurindo de Sousa Britto Neto
  • Maria Cecília Calani Baranauskas
  • Siome Klein Goldenstein
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8513)


The idea of interacting with technologies through touch-less and body-based interfaces has caused great excitement amongst users, but for the designers it has created various new challenges. Usability encompasses part of these challenges, and there have been attempts at creating heuristics for NUIs design. However, most of these heuristics consider using a device such as Kinect for the recognition of gestures, not people or objects. Therefore, in this paper we investigate the subject by presenting a systematic literature review aimed at finding heuristics for the design and evaluation of NUIs. Our analysis focuses on the scenario of helping people with visual disabilities in their daily activities. By looking at the state of the art, we intend to verify how many and which heuristics fit in this context.


Human-Computer Interaction HCI Accessibility Assistive Technologies 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bailly, G., Müller, J., Lecolinet, E.: Design and evaluation of finger-count interaction: Combining multitouch gestures and menus. Int. J. Hum. Comput. Stud. 70, 673–689 (2012)CrossRefGoogle Scholar
  2. 2.
    Block, F., Wigdor, D., Phillips, B.C., Horn, M.S., Shen, C.: FlowBlocks: A Multi-Touch UI for Crowd Interaction. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, UIST 2012, pp. 497–508. ACM, Cambridge (2012)Google Scholar
  3. 3.
    Cox, D., Wolford, J., Jensen, C., Beardsley, D.: An evaluation of game controllers and tablets as controllers for interactive tv applications. In: Proceedings of the 14th ACM International Conference on Multimodal Interaction, ICMI 2012, p. 181. ACM Press, New York (2012)Google Scholar
  4. 4.
    Cuccurullo, S., Francese, R., Murad, S., Passero, I., Tucci, M.: A gestural approach to presentation exploiting motion capture metaphors. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, AVI 2012, pp. 148–155. ACM Press, New York (2012)CrossRefGoogle Scholar
  5. 5.
    Ertin, E., Stohs, N., Kumar, S., Raij, A., Al’Absi, M., Shah, S.: AutoSense: Unobtrusively Wearable Sensor Suite for Inferring the Onset, Causality, and Consequences of Stress in the Field. In: Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems, SenSys 2011, pp. 274–287. ACM, Seattle (2011)Google Scholar
  6. 6.
    Frisch, M., Heydekorn, J., Dachselt, R.: Diagram Editing on Interactive Displays Using Multi-touch and Pen Gestures. In: Goel, A.K., Jamnik, M., Narayanan, N.H. (eds.) Diagrams 2010. LNCS, vol. 6170, pp. 182–196. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  7. 7.
    Garzotto, F., Valoriani, M., Milano, P.: Touchless Gestural Interaction with Small Displays: A Case Study. In: Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI - CHItaly 2013, pp. 1–10. ACM, Trento (2013)CrossRefGoogle Scholar
  8. 8.
    Gomes, A., Oh, H., Chisik, Y., Chen, M.: Ilha Musical: a CAVE for nurturing cultural appreciation. In: Proceedings of the 11th International Conference on Interaction Design and Children, IDC 2012, Bremen, Germany, pp. 232–235 (2012)Google Scholar
  9. 9.
    Jankowski, J., Decker, S.: A Dual-Mode User Interface for Accessing 3D Content on the World Wide Web Categories and Subject Descriptors. In: Proceedings of the 21st International Conference on World Wide Web, pp. 1047–1056. ACM, Lyon (2012)CrossRefGoogle Scholar
  10. 10.
    Klompmaker, F., Paelke, V.: A Taxonomy-Based Approach Towards NUI Interaction Design. In: TEI 2013, pp. 32–41. ACM, Barcelona (2013)Google Scholar
  11. 11.
    Liberati, A., Altman, D.G., Tetzlaff, J., Mulrow, C., Gotzsche, P.C., Ioannidis, J.P., Clarke, M., Devereaux, P.J., Kleijnen, J., Moher, D.: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 6, 27 (2009)Google Scholar
  12. 12.
    Lin, S., Shie, C., Chen, S., Hung, Y.: AirTouch Panel: A Re-Anchorable Virtual Touch Panel. In: Proceedings of the 21st ACM International Conference on Multimedia, MM 2013, pp. 625–628. ACM, Barcelona (2013)Google Scholar
  13. 13.
    Nebe, K., Klompmaker, F., Jung, H., Fischer, H.: Exploiting New Interaction Techniques for Disaster Control Management Using Multitouch-, Tangible- and Pen-Based-Interaction. In: Jacko, J.A. (ed.) Human-Computer Interaction, Part II, HCII 2011. LNCS, vol. 6762, pp. 100–109. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  14. 14.
    Nielsen, J.: Usability Engineering (1994)Google Scholar
  15. 15.
    O’Hara, K., Harper, R., Mentis, H., Sellen, A., Taylor, A.: On the Naturalness of Touchless: Putting the “Interaction” Back into NUI. ACM Trans. Comput. Interact. 20, 1–25 (2013)CrossRefGoogle Scholar
  16. 16.
    Oh, J., Jung, Y., Cho, Y., Hahm, C., Education, S.S., Sin, H., Science, C., Lee, J.: Hands-Up: Motion Recognition using Kinect and a Ceiling to Improve the Convenience of Human Life. In: CHI 2012 Extended Abstracts on Human Factors in Computing Systems, pp. 1655–1660. ACM (2012)Google Scholar
  17. 17.
    Sae-bae, N., Ahmed, K., Isbister, K., Memon, N.: Biometric-Rich Gestures: A Novel Approach to Authentication on Multi-touch Devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2012, pp. 977–986 (2012)Google Scholar
  18. 18.
    Sanna, A., Lamberti, F., Paravati, G., Rocha, F.D.: A kinect-based interface to animate virtual characters. J. Multimodal User Interfaces 7, 269–279 (2012)CrossRefGoogle Scholar
  19. 19.
    Shiratuddin, M.F., Wong, K.W.: Game Design Considerations When Using Non-touch Based Natural User Interface. In: Pan, Z., Cheok, A.D., Müller, W., Chang, M., Zhang, M. (eds.) Transactions on Edutainment VIII. LNCS, vol. 7220, pp. 35–45. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  20. 20.
    Wigdor, D., Wixon, D.: Brave NUI World (2011)Google Scholar
  21. 21.
    Yang, J., Dekker, A., Muhlberger, R., Viller, S.: Exploring Virtual Representations of Physical Artefacts in a Multi-touch Clothing Design Collaboration System. In: Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group, OZCHI 2009, pp. 353–356. ACM, Melbourne (2009)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Vanessa Regina Margareth Lima Maike
    • 1
  • Laurindo de Sousa Britto Neto
    • 1
    • 2
  • Maria Cecília Calani Baranauskas
    • 1
  • Siome Klein Goldenstein
    • 1
  1. 1.Institute of ComputingState University of Campinas (UNICAMP)CampinasBrazil
  2. 2.Departament of ComputingFederal University of Piauí (UFPI)TeresinaBrazil

Personalised recommendations