Using Computer Graphics, Vision and Gesture Recognition Tools for Building Interactive Systems Supporting Therapy of Children

  • J. Marnik
  • S. Samolej
  • T. Kapuściński
  • M. Oszust
  • M. Wysocki
Part of the Advances in Intelligent and Soft Computing book series (AINSC, volume 98)

Abstract

The paper presents a prototype of a system which can be used as a therapeutic and educational tool for children with developmental problems. Natural body movements and gestures are used in the system to interact with virtual objects displayed on the screen. Nowadays such systems can be built with the use of widely available free software tools for both graphical and vision applications. Such tools are also shortly presented in the paper.

Keywords

Autism Spectrum Disorder Gesture Recognition Virtual Character Graphic Object Graphic Scene 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [Bobick and Davis 2001]
    Bobick, A., Davis, J.: The representation and recognition of action using temporal templates. IEEE Trans. on Pattern Analysis and Machine Intelligence 23(3), 257–267 (2001)CrossRefGoogle Scholar
  2. [Bradski and Kaehler 2008]
    Bradski, G., Kaehler, A.: Learning OpenCV: computer vision with the OpenCV library. O’Reilly Media, Inc., Sebastopol (2008)Google Scholar
  3. [Gonçalves et al. 2008]
    Gonçalves, D., Jesus, R., Grangeiro, F., et al.: Tag around: a 3D gesture game for image annotation. In: Proc In ACE 2008, Yokohama, Japan, pp. 259–262 (2008)Google Scholar
  4. [Herbelin et al. 2008]
    Herbelin, B., Ciger, J., Brooks, A.L.: Customization of gaming technology and prototyping of rehabilitation applications. In: Proc. 7th ICDVRAT with Art Abilitation, Maia, Portugal, pp. 211–218 (2008)Google Scholar
  5. [Kapuscinski and Wysocki 2005]
    Kapuscinski, T., Wysocki, M.: Automatic recognition of signed polish expressions. Archives of Control Sciences 15(3), 251–259 (2005)Google Scholar
  6. [Kapuscinski 2010]
    Kapuscinski, T.: Using hierarchical temporal memory for vision-based hand shape recognition under large variations of hand’s rotation. In: Rutkowski, L., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2010. LNCS, vol. 6113, pp. 272–279. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  7. [Krais 2006]
    Krais, K.F.: Advanced man-machine interaction. Fundamentals and Implementation. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. [Marnik 2009]
    Marnik, J.: Hand shape recognition for human-computer interaction. In: Cyran, K.A., et al. (eds.) Man-Machine Interactions. AISC, vol. 59, pp. 95–102. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  9. [WWW-1 2010]
    SilverFit System, http://silverfit.nl/en/index.htm (accessed November 29, 2010)
  10. [WWW-2 2010]
    The AuRoRa Project, http://www.aurora-project.com/ (accessed November 29, 2010)

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • J. Marnik
    • 1
  • S. Samolej
    • 1
  • T. Kapuściński
    • 1
  • M. Oszust
    • 1
  • M. Wysocki
    • 1
  1. 1.Rzeszow University of TechnologyRzeszowPoland

Personalised recommendations