Skip to main content
SpringerLink
Log in

Non-formal therapy and learning potentials through human gesture synchronised to robotic gesture

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

Children with severe physical disabilities have limited possibilities for joyful experiences and interactive play. Physical training and therapy to improve such opportunities for these children is often enduring, tedious and boring through repetition—and this is often the case for both patient and the facilitator or therapist. The aim of the study reported in this paper was to explore how children with a severe physical disability could use an easily accessible robotic device that enabled control of projected images towards achieving joyful experiences and interactive play, so as to give opportunities for use as a supplement to traditional rehabilitation therapy sessions. The process involves the capturing of gesture data through an intuitive non-intrusive interface. The interface is invisible to the naked eye and offers a direct and immediate association between the child’s physical feed-forward gesture and the physical reaction (feedback) of the robotic device. Results from multiple sessions with four children with severe physical disability suggest that the potential of non-intrusive interaction with a multimedia robotic device that is capable of giving synchronized physical response offers additional opportunities, and motivated non-formal potentials in therapy and learning to supplement the field.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. http://www.martin.com/product/product.asp?product=minimacprofile.

  2. http://www.cycling74.com.

  3. http://www.soundbeam.co.uk.

References

  1. Aderklou, C., Fritzdorf, L., Petersson, E.: Pl@yground: Pedagogical Innovation and Play Products Created to Expand Self-development through Child Collaboration through Computer-Mediated-Communication (CMC). Socrates, Leonardo & Youth, Halmstad University, Halmstad (2001)

  2. Atkinson, P., Delamont, S.: Analytic perspectives. In: Denzin, N.K., Lincoln, Y.S. (eds.) The Sage Handbook of Qualitative Research, 3rd edn. SAGE, Thousand Oaks (2005)

    Google Scholar 

  3. Berg, L.E.: The Playing Human (Swe). Studentlitteratur, Lund (1992)

    Google Scholar 

  4. Bigün, J., Petersson, E., Dahiya, R.: Multimodal interfaces—Designing digital artifacts together with children. In: Seventh International Conference on Learning and Educational Media. Bratislava (2003)

  5. Brooks, A., Hasselblad, S.: CAREHERE—creating aestetically resonant environments for the handicapped, elderly and rehabilitation: Sweden. In: International Conference on disability, virtual reality, and associated technologies. Oxford, pp. 191–198 (2004)

  6. Brooks, A., Petersson, E.: Recursive reflection and learning in raw data video analysis of interactive ‘play’ environments for special needs health care. In: Seventh International Workshop on Enterprise Networking and Computing in Healthcare Industry, pp. 83–87 (2005)

  7. Brooks, A., Petersson, E.: Raw emotional signalling via expressive behavior. In: International Conference Artificial Reality and Telexistence, pp. 133–141 (2005)

  8. Brooks, A., Petersson, E.: Play therapy utilizing Sony EyeToy®. In: Slater, M. (ed.) Eighth International Workshop on Presence, pp. 303–310 (2005)

  9. Cook, A.M., Meng, M.Q.H., Gu, J.J., Howery, K.: Development of a robotic device for facilitating learning by children who have severe disabilities. Trans. Neural Rehab. Eng. 10(3): 178–187 (2002)

    Article  Google Scholar 

  10. Csikszentmihalyi, M.: Flow: The psychology of optimal experience. Natur & Kultur, Stockholm (1992)

    Google Scholar 

  11. Dautenhahn, K., Woods, S., Kaouri, C., Michael, L.W., Kheng, L.K., Werry, I.: What is a robot companion—friend, assistant or Butler? In: International Conference on Intelligent Robots and System, pp. 788–795 (2005)

  12. Fagan, R.: Animal Play Behavior. Oxford University Press, New York (1981)

    Google Scholar 

  13. Fujita, Y.: Personal robot PaPeRo and its application as childcare robot. In: ROBOCASA, pp. 36–42 (2005)

  14. Harmo, P., Taipalus, T., Knuuttila, J., Valet, J., Halme, A.: Needs and solution—home automation and service robots for the elderly and disabled. In: International Conference on Intelligent Robots and Systems, pp. 145–152 (2005)

  15. Hogan, N.: MIT-Manus robot aids physical therapy of stroke victims. MIT, Boston (2000)

    Google Scholar 

  16. Kahn, P., Friedman, B., Perez-Granados, D., Freier, N.: Robotic pets in the lives of preschool children. In: Conference on Human Factors in Computing Systems, pp. 1449–1452 (2004)

  17. Kozima, H., Nakagawa, C., Yano, H.: Using robots for the study of human social development. In: AAAI Spring Symposium, pp. 111–114 (2005)

  18. Lave, J., Wenger, E.: Situated Learning. Legitimate Peripheral Participation. Cambridge University Press, New York (1991)

    Google Scholar 

  19. Merriam, S.B.: Qualitative Research and Case Study Applications in Education. Jossey-Bass, SF (1998)

    Google Scholar 

  20. Nabe, S., Kanda, T., Hiraki, K., Ishigurio, H., Hagita, N.: Human friendship estimation model for communication robots. In: International Conference on Humanoid Robots, pp. 196–201 (2005)

  21. Nakauchi, Y., Fukuda, T., Noguchi, K., Matsubara, T: Intelligent kitchen: cooking support system by LCD and mobile robot with IC-labeled objects. In: International Conference on Intelligent Robots and Systems, pp. 76–84 (2005)

  22. Petersson, E.: Innovative play products—development of toys for children’s play and rehabilitation. In: SNAFA Conference Proceedings. Halmstad University, Halmstad (Abstract) (2000)

  23. Petersson, E.: Using and developing new learning technologies by integrating physical and virtual toy systems. Socrates, Leonardo & Youth, Halmstad University, Halmstad (2004)

  24. Rogoff, B.: Apprenticeship in Thinking. Cognitive Development in Social Context. Oxford University, New York (1990)

    Google Scholar 

  25. Scherer, K.: Emotion. In: Hewstone, M., Stoebe, W. (eds.) Introduction to Social Psychology: A European Perspective, 3rd edn. pp. 151–191, Blackwell, Oxford (2000)

    Google Scholar 

  26. Schön, D.: Educating the Reflective Practitioner: Toward a New Design for Teaching and Learning in the Professions. Jossey-Bass, San Fransisco (1987)

    Google Scholar 

  27. Shibata, T., Irie, R.: Artificial Emotional Creature for Human–Robot Interaction—A New Direction for Intelligent System. In: International Conference on Adv Intelligent Mechatronics, paper 47 (1997)

  28. Simo, A., Kitamura, K., Nishida, Y.: Behavior based Children Accidents’ Simulation and Visualization: Planning the Emergent Situations. In: Fourth International Conference on Computational Intelligence, pp. 487–157 (2005)

  29. Stake, R.E.: Qualitative case studies. In: Denzin, N.K., Lincoln, Y.S. (eds.) The Sage Handbook of Qualitative Research, 3rd edn. SAGE, Thousand Oaks (2005)

    Google Scholar 

  30. Starrin, B.: Participatory research—to create knowledge together (Swe). In: Holmer, J., Starrin, B. (eds.) Participatory oriented research (Swe). Studentlitteratur, Lund (1993)

    Google Scholar 

  31. Starrin, B.: Applied social research (Swe). In: Holmer, J., Starrin, B. (eds.) Participatory oriented research (Swe). Studentlitteratur, Lund (1993)

    Google Scholar 

  32. Vygotsky, L.S.: Mind in Society. Harvard University, Cambridge (1978)

    Google Scholar 

  33. Vygotsky, L.S.: The collected works of L. S. Vygotsky: Vol. 1. Problems of general psychology. Plenum, New York (1987)

    Google Scholar 

  34. Woods, S., Dautenhahn, K., Schulz, J.: The design space of robots: Investigating children’s perspective. In: International Workshop on Robot and Human Interactive Communication, pp. 237–243 (2004)

  35. Yamamoto, D., Doi, M., Matsushira, N., Ueda, H., Kidode, M.: Familiar behaviors evaluation for a robotic interface of practicality and familiarity. In: International Conference on Development and Learning, pp. 149–154 (2005)

Download references

Acknowledgments

The authors’ wishes to thank the institute staff and children involved in the study as well as CAVI (Center for Advanced Visualization and Interactivity), Aarhus, Denmark where the research was hosted.

Author information

Authors and Affiliations

  1. Department of Software and Media Technology, Aalborg University Esbjerg, Niels Bohrs Vej 8, 6700, Esbjerg, Denmark

    E. Petersson & A. Brooks

Authors
  1. E. Petersson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. Brooks
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to E. Petersson.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Petersson, E., Brooks, A. Non-formal therapy and learning potentials through human gesture synchronised to robotic gesture. Univ Access Inf Soc 6, 167–177 (2007). https://doi.org/10.1007/s10209-007-0081-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-007-0081-0

Keywords

Search

Navigation