Understanding Movement and Interaction: An Ontology for Kinect-Based 3D Depth Sensors

  • Natalia Díaz Rodríguez
  • Robin Wikström
  • Johan Lilius
  • Manuel Pegalajar Cuéllar
  • Miguel Delgado Calvo Flores
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8276)


Microsoft Kinect has attracted great attention from research communities, resulting in numerous interaction and entertainment applications. However, to the best of our knowledge, there does not exist an ontology for 3D depth sensors. Including automated semantic reasoning in these settings would open the doors for new research, making possible not only to track but also understand what the user is doing. We took a first step towards this new paradigm and developed a 3D depth sensor ontology, modelling different features regarding user movement and object interaction. We believe in the potential of integrating semantics into computer vision. As 3D depth sensors and ontology-based applications improve further, the ontology could be used, for instance, for activity recognition, together with semantic maps for supporting visually impaired people or in assistance technologies, such as remote rehabilitation.


Ontology Kinect Human Activity Modelling and Recognition Ubiquitous Computing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Weiser, M.: The computer for the twenty-first century. Scientific American 165, 94–104 (1991)CrossRefGoogle Scholar
  2. 2.
    Gómez-Romero, J., Patricio, M.A., Garcìa, J., Molina, J.M.: Ontology-based context representation and reasoning for object tracking and scene interpretation in video. Expert Systems with Applications 38(6), 7494–7510 (2011)CrossRefGoogle Scholar
  3. 3.
    Chen, L., Nugent, C.D.: Ontology-based activity recognition in intelligent pervasive environments. International Journal of Web Information Systems (IJWIS) 5(4), 410–430 (2009)CrossRefGoogle Scholar
  4. 4.
    Kim, E., Helal, S., Cook, D.: Human activity recognition and pattern discovery. IEEE Pervasive Computing 9(1), 48–53 (2010)CrossRefGoogle Scholar
  5. 5.
    Henry, P., Krainin, M., Herbst, E., Ren, X., Fox, D.: RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments. The International Journal of Robotics Research 31(5), 647–663 (2012)CrossRefGoogle Scholar
  6. 6.
    Kinect@Home Project, KTH, (2012)
  7. 7.
    Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., Fitzgibbon, A.: KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST 2011, pp. 559–568 (2011)Google Scholar
  8. 8.
    d‘Aquin, M., Noy, N.F.: Where to publish and find ontologies? a survey of ontology libraries. Web Semantics: Science, Services and Agents on the World Wide Web 11, 96–111 (2012)CrossRefGoogle Scholar
  9. 9.
    Foukarakis, M.: Informational system for managing photos and spatial information using sensors, ontologies and semantic maps. PhD thesis, Technical University of Crete (2009)Google Scholar
  10. 10.
  11. 11.
    Hudelot, C., Atif, J., Bloch, I.: Fuzzy spatial relation ontology for image interpretation. Fuzzy Sets Syst. 159(15), 1929–1951 (2008)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Suárez-Figueroa, M.C.: NeOn Methodology for building ontology networks: specification, scheduling and reuse. PhD thesis, Universidad Politécnica de Madrid (2010)Google Scholar
  13. 13.
    Ismail, A.A., Florea, A.M.: Multimodal indoor tracking of a single elder in an AAL environment. In: 5th International Symposium on Ambient Intelligence, pp. 137–145 (2013)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • Natalia Díaz Rodríguez
    • 1
  • Robin Wikström
    • 2
  • Johan Lilius
    • 1
  • Manuel Pegalajar Cuéllar
    • 3
  • Miguel Delgado Calvo Flores
    • 3
  1. 1.Turku Centre for Computer Science (TUCS), Department of ITÅbo Akademi UniversityTurkuFinland
  2. 2.IAMSRÅbo Akademi UniversityTurkuFinland
  3. 3.Department of Computer Science and Artificial IntelligenceUniversity of GranadaSpain

Personalised recommendations