Skip to main content

Serious…ly! Just Kidding in Personalised Therapy Through Natural Interactions with Games

  • Conference paper
  • First Online:
Advances in Computer Entertainment Technology (ACE 2017)

Abstract

Virtual Reality based rehabilitation is much based on sensing devices that capture and quantitatively assess the patients’ movements to track their progress more accurately. There are a few commercially available and affordable sensors. Among them, Kinect is an important asset to the concept of Natural User Interfaces, which is gaining a wider space and great importance in gaming for therapy approaches. These solutions can create therapy environments that increase the motivation of patients to achieve successful completion of rehabilitation programs that can be very demanding. However, therapists still demand customisable tools towards particular groups of patients. This paper presents “just Physio kidding”, which is a solution based on the use of serious games, natural user interfaces and personalisation to address both physiotherapy and cognitive stimulation therapy. Initially, it was designed for stroke patients and older adults on wheelchairs, then it was adapted to children with special needs. The paper details the game design, its underlying concept and platform, besides presenting the first user study with experts, which points out to the design of a personalised version.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 179.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 229.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. d’Ornellas, M.C., Cargnin, D.J., Cervi Prado, A.L.: A thoroughly approach to upper limb rehabilitation using serious games for intensive group physical therapy or individual biofeedback training. In: Proceedings of the 2014 Brazilian Symposium on Computer Games and Digital Entertainment (SBGAMES 2014), pp. 140–147. IEEE, Washington (2014)

    Google Scholar 

  2. Chang, C.-Y., Lange, B., Zhang, M., Koenig, S., Requejo, P., Somboon, N., Sawchuk, A.A., Rizzo, A.A.: Towards pervasive physical rehabilitation using microsoft kinect. In: Proceedings of PervasiveHealth 2012, pp. 159–162. ICST, Brussels (2012)

    Google Scholar 

  3. Hondori, H.M., Khademi, M.: A review on technical and clinical impact of microsoft kinect on physical therapy and rehabilitation. J. Med. Eng. (2014)

    Google Scholar 

  4. Tanaka, K., Parker, J., Baradoy, G., Sheehan, D., Holash, J., Katz, L.: A comparison of exergaming interfaces for use in rehabilitation programs and research. Loading 6(9), 69–81 (2012)

    Google Scholar 

  5. De Gama, A., Fallavoillta, P., Teichrieb, V., Navab, N.: Motor rehabilitation using kinect: a systematic review. Games Health J. 4, 123–125 (2015)

    Article  Google Scholar 

  6. Deterding, S., Sicart, M., Nacke, L., O’Hara, K., Dixon, D. Gamification: using game-design elements in non-gaming contexts. In: Proceedings of the CHI 2011 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2011), pp. 2425–2428. ACM, New York (2011)

    Google Scholar 

  7. Waddington, J., Linehan, C., Gerling, K., Hicks, K., Hodgson, T.L.: Participatory design of therapeutic video games for young people with neurological vision impairment. In: Proceedings of CHI 2015, pp. 3533–3542. ACM, New York (2015)

    Google Scholar 

  8. Hernandez, H.A., Graham, T.C.N., Fehlings, D., Switzer, L., Ye, Z., Bellay, Q., Hamza, M.A., Savery, C., Stach, T.: Design of an exergaming station for children with cerebral palsy. In: Proceedings of CHI 2012, pp. 2619–2628. ACM, New York (2012)

    Google Scholar 

  9. Wiemeyer, J., Kliem, A.: Serious games in prevention and rehabilitation - a new panacea for elderly people? Eur. Rev. Aging Phys. Act. 9(1), 41–50 (2012)

    Article  Google Scholar 

  10. Kato, P.M., Cole, S.W., Bradlyn, A.S., Pollock, B.H.: A video game improves behavioral outcomes in adolescents and young adults with cancer: a randomized trial. Pediatrics 122(2), 305–317 (2008)

    Article  Google Scholar 

  11. Achtman, R.L., Green, C.S., Bavelier, D.: Video games as a tool to train visual skills. Restor. Neurol. Neurosci. 26(4–5), 435–446 (2008)

    Google Scholar 

  12. Sveistrup, H.: Motor rehabilitation using virtual reality. J. Neuroeng. Rehabil. 10, 1–10 (2004)

    Google Scholar 

  13. Clark, R.A., Pua, Y.-H., Bryant, A.L., Hunt, M.A.: Validity of the Microsoft Kinect for providing lateral trunk lean feedback during gait retraining. Gait Posture 38(4), 1064–1066 (2013)

    Article  Google Scholar 

  14. Huang, J.D.: Kinerehab: a kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. In: Proceedings of ASSETS 2011, pp. 319–320. ACM (2011)

    Google Scholar 

  15. Freitas, D.Q., Da Gama, A., Figueiredo, L., Chaves, T.M., Marques-Oliveira, D., Teichrieb, V., Araújo, C.: Development and evaluation of a kinect based motor rehabilitation game. In: Proceedings of SBGames, pp. 144–153 (2012)

    Google Scholar 

  16. Gerling, K., Livingston, I., Nacke, L., Mandryk, R.: Full-body motion-based game interaction for older adults. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1873–1882. ACM, Austin (2012)

    Google Scholar 

  17. Madeira, R.N., Costa, L., Postolache, O.: PhysioMate - Pervasive physical rehabilitation based on NUI and gamification. In: Proceedings of EPE 2014, pp. 612–616. IEEE (2014)

    Google Scholar 

  18. Maggiorini, D., Ripamonti, L.A., Zanon, E.: Supporting seniors rehabilitation through videogame technology: a distributed approach. In: Proceedings of the Second International Workshop on Games and Software Engineering: realizing User Engagement with Game Engineering Techniques (GAS 2012), pp. 16–22. IEEE Press, Piscataway (2012)

    Google Scholar 

  19. Marston, H.R., Smith, S.T.: Interactive Videogame Technologies to Support Independence in the Elderly: A Narrative Review. Games Health J. 1(2), 139–152 (2012)

    Article  Google Scholar 

  20. Ma, M., Bechkoum, K.: Serious games for movement therapy after stroke. In: IEEE International Conference on Systems, Man and Cybernetics, pp. 872-877 (2008)

    Google Scholar 

  21. Lange, B., Chang, C., Suma, E., Newman, B., Rizzo, A.S., Bolas, M.: Development and evaluation of low cost game-based balance rehabilitation tool using the microsoft kinect sensor. In: International Conference of the Engineering in Medicine and Biology Society, pp. 1831–1834 (2011)

    Google Scholar 

  22. Luna-Oliva, L., Ortiz-Gutiérrez, R.M., Cano-de la Cuerda, R., Piédrola, R.M., Alguacil-Diego, I.M., Sánchez-Camarero, C., Martínez Culebras Mdel, C.: Kinect Xbox 360 as a therapeutic modality for children with cerebral palsy in a school environment: A preliminary study. J. NeuroRehabilitation 33(4), 513–521 (2013)

    Google Scholar 

  23. Hernandez, H.A., Ye, Z., Nicholas Graham, T.C., Fehlings, D., Switzer, L.: Designing action-based exergames for children with cerebral palsy. In: Proceedings of SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), pp. 1261–1270. ACM, New York (2013)

    Google Scholar 

  24. Chang, Y.J., Han, W.Y., Tsai, Y.C.: A Kinect-based upper limb rehabilitation system to assist people with cerebral palsy. Res. Dev. Disabil. 34(11), 3654–3659 (2013)

    Article  Google Scholar 

  25. Human-Automation Systems Lab at Georgia Tech. SuperPop Project develops game for children with motor skills impairments. http://www.engadget.com/gallery/superpop-project-at-georgia-tech/. Accessed 27 July 2017

  26. de Greef, K., van der Spek, E.D., Bekker, T.: Designing Kinect games to train motor skills for mixed ability players. In: Proceedings of the 3rd European Conference on Gaming and Playful Interaction in Health Care (Games for Health 2013), pp. 197–205 (2013)

    Google Scholar 

  27. Patil, Y., Sarris, M., Gunter, M., Averette, L.: PLANET 10: a space odyssey. In: Proceedings of CHI PLAY Companion 2016, pp. 67–70. ACM, New York (2016)

    Google Scholar 

  28. Vinkler, M., Sochor, J.: Integrating motion tracking sensors to human-computer interaction with respect to specific user needs. In: Proceedings of CESCG 2014: The 18th Central European Seminar on Computer Graphics (2014)

    Google Scholar 

  29. Zhu, G., Cai, S., Ma, Y., Liu, E.: A series of leap motion-based matching games for enhancing the fine motor skills of children with autism. In: 2015 Proceedings of 15th International Conference on Advanced Learning Technologies, Hualien, pp. 430–431. IEEE (2015)

    Google Scholar 

  30. Penelle, B., Debeir, O.: Multi-sensor data fusion for hand tracking using kinect and leap motion. In: Proceedings of the 2014 Virtual Reality International Conference (VRIC 2014), 7 p. ACM, New York (2014). Article 22

    Google Scholar 

  31. Hamari, J., Koivisto, J., Sarsa, H.: Does gamification work? – A literature review of empirical studies on gamification. In: Proceedings of System Sciences 2014, pp. 3025–3034. IEEE (2014)

    Google Scholar 

  32. Zichermann, G., Cunningham, C.: Gamification by Design Implementing Game Mechanics in Web and Mobile Apps, p. 36. O’Reilly Media, Sebastopol (2011)

    Google Scholar 

  33. Martins, A.I., Rosa, A.F., Queirós, A., Silva, A., Rocha, N.P.: European Portuguese validation of the system usability scale (SUS). Procedia Comput. Sci. 67, 293–300 (2015)

    Article  Google Scholar 

  34. Brooke, J.: SUS: A ‘quick and dirty’ usability scale. In: Jordan, P.W., Thomas, B., Weerdmeester, B.A., McClelland, I.L. (eds.) Usability Evaluation in Industry, pp. 189–194. Taylor & Francis, London (1996)

    Google Scholar 

  35. Sauro, J.: A Practical Guide to the System Usability Scale: Background, Benchmarks, & Best Practices. Measuring Usability LLC, Denver (2011)

    Google Scholar 

Download references

Acknowledgments

We thank clinic “Cresce com Amor” for providing the support needed for the tests with the end-users. Special thanks to therapist Ana Carolina Bernardo for her particular participation in the jPk design and tests supervision. This research is supported by Instituto de Telecomunicações, IT-IUL, at ISCTE-IUL, Lisbon, Portugal, and Fundação para Ciência e Tecnologia under the project “TailorPhy - Smart Sensors and Tailored Environments for Physiotherapy” with the grant PTDC/DTP-DES/6776/2014.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rui Neves Madeira .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Madeira, R.N., Antunes, A., Postolache, O., Correia, N. (2018). Serious…ly! Just Kidding in Personalised Therapy Through Natural Interactions with Games. In: Cheok, A., Inami, M., Romão, T. (eds) Advances in Computer Entertainment Technology. ACE 2017. Lecture Notes in Computer Science(), vol 10714. Springer, Cham. https://doi.org/10.1007/978-3-319-76270-8_50

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-76270-8_50

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-76269-2

  • Online ISBN: 978-3-319-76270-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics