Skip to main content

An autonomous robotic exercise tutor for elderly people

Abstract

Ambient assisted living proposes to utilize technological solutions to sustain the well being of elderly people. In accordance with the vision of successful aging, we describe in this study an autonomous robotic exercise tutor for elderly people. The robot learns a set of physical exercises from a human demonstrator in an imitation framework, and performs these motions in an exercise scenario, while monitoring the elderly person to provide verbal feedback. We developed an exercise program in collaboration with a nursing home, and tested our system in a real world scenario with visitors of a day care center, over multiple sessions. We provide a detailed description of the system implementation, as well as our observations for the exercise program. For the study held in the day care center, video annotations and user self-assessments are evaluated to measure the overall performance of the system and to validate our approach. The analysis revealed that elderly people can successfully exercise with the assistance of the robot, while staying engaged with the system over multiple sessions.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Notes

  1. This paper extends our earlier work (Görer et al. 2013) with a complete feedback system, increased social capabilities, studies with elderly over multiple sessions, evaluation of communicative behavior, and evaluation of user satisfaction.

  2. This is mostly due to the fact that speech recognition tools in Turkish language are limited, compared to tools developed for English language.

  3. http://ab-initio.mit.edu/nlopt.

  4. www.aldebaran-robotics.com.

  5. http://doc.aldebaran.com/1-14/software/index.html.

  6. All questionnaires used in this study can be obtained by contacting the corresponding author.

  7. A sample session can be seen at https://youtu.be/lbLo3-oIi8o.

  8. https://tla.mpi.nl/tools/tla-tools/elan/ (Wittenburg et al. 2006).

  9. We did not assess personality formally, in order to keep the setup simpler.

  10. We did not use a formalism for coding facial actions but described the expected expressions from the existing literature. Nevertheless, the annotations show high inter-annotator consistency.

References

  • Bainbridge, W. A., Hart, J, Kim, E. S. & Scassellati, B. (2008). The effect of presence on human-robot interaction. In: The 17th IEEE International Symposium on Robot and Human Interactive Communication, pp. 701–706.

  • Barnes, P., Spooner, T., Dhabolt, J., & Leighton, J. (2009). Instructional gaming methods and apparatus. Patent, A1, 20090176581.

  • Billard, A., Calinon, S., Dillmann, R. & Schaal, S. (2008). Robot programming by demonstration. In: Springer handbook of robotics, Springer, pp. 1371–1394.

  • Broekens, J., Heerink, M., & Rosendal, H. (2009). Assistive social robots in elderly care: A review. Gerontechnology, 8(2), 94–103.

    Article  Google Scholar 

  • Brooks, D. A. (2012). Quantifying upper-arm rehabilitation metrics for children through interaction with a humanoid robot. PhD thesis, Georgia Institute of Technology.

  • Colombo, R., Pisano, F., Mazzone, A., Delconte, C., Micera, S., Carrozza, M., et al. (2007). Design strategies to improve patient motivation during robot-aided rehabilitation. Journal of NeuroEngineering and Rehabilitation, 4(1), 3–12.

    Article  Google Scholar 

  • Dautenhahn, K., Woods, S., Kaouri, C., Walters, M. L., Koay, K. L. & Werry, I. (2005). What is a robot companion - friend, assistant or butler? In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1192–1197.

  • Ezer, N., Fisk, A. D., & Rogers, W. A. (2009a). Attitudinal and intentional acceptance of domestic robots by younger and older adults. In Universal access in human-computer interaction (pp. 39–48). Intelligent and Ubiquitous Interaction Environments: Springer.

  • Ezer, N., Fisk, A. D., & Rogers, W. A. (2009b). More than a servant: Self-reported willingness of younger and older adults to having a robot perform interactive and critical tasks in the home. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, SAGE Publications, 53, pp. 136–140.

  • Fasola, J., & Mataric, M. (2012). Using socially assistive human-robot interaction to motivate physical exercise for older adults. Proceedings of the IEEE, 100(8), 2512–2526.

    Article  Google Scholar 

  • Fasola, J., & Mataric, M. (2013). A socially assistive robot exercise coach for the elderly. Journal of Human-Robot Interaction, 2(2), 3–32.

    Article  Google Scholar 

  • Fasola, J., & Matarić, M. J. (2013). A socially assistive robot exercise coach for the elderly. Journal of Human-Robot Interaction, 2(2), 3–32.

    Article  Google Scholar 

  • Feil-Seifer, D. & Mataric, M. (2005). Defining socially assistive robotics. In: 9th International Conference on Rehabilitation Robotics, ICORR, pp. 465–468.

  • Feil-Seifer, D., & Mataric, M. (2011). Socially assistive robotics. Robotics Automation Magazine, IEEE, 18(1), 24–31.

    Article  Google Scholar 

  • Gadde, P., Kharrazi, H., Patel, H., & MacDorman, K. F. (2011). Toward monitoring and increasing exercise adherence in older adults by robotic intervention: A proof of concept study. Journal of Robotics, 1, 1–11.

    Article  Google Scholar 

  • Giuliani, M., Scopelliti, M., & Fornara, F. (2005). Elderly people at home: technological help in everyday activities. In: IEEE International Workshop on Robot and Human Interactive Communication, IEEE, pp. 365–370.

  • Görer, B., Salah, A. A. & Akın, H. L. (2013). A robotic fitness coach for the elderly. In: Ambient Intelligence, Springer, pp. 124–139.

  • Heerink, M. (2010). Assessing acceptance of assistive social robots by aging adults. PhD thesis, University of Amsterdam.

  • Heerink, M., Kröse, B., Evers, V., Wielinga, B., et al. (2008). The influence of social presence on acceptance of a companion robot by older people. Journal of Physical Agents, 2(2), 33–40.

    Google Scholar 

  • Hu, K., Ott, C., & Lee, D. (2014). Online human walking imitation in task and joint space based on quadratic programming. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 3458–3464.

  • Kidd, C. & Breazeal, C. (2004). Effect of a robot on user perceptions. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vol. 4, pp. 3559–3564.

  • Klamer, T. & Allouch, S. B. (2010). Acceptance and use of a social robot by elderly users in a domestic environment. In: 4th International Conference on Pervasive Computing Technologies for Healthcare, pp. 1–8.

  • Koenemann, J., Burget, F. & Bennewitz, M. (2014). Real-time imitation of human whole-body motions by humanoids. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), IEEE, pp. 2806–2812.

  • Kuniyoshi, Y., Inaba, M., & Inoue, H. (1994). Learning by watching: Extracting reusable task knowledge from visual observation of human performance. IEEE Transactions on Robotics and Automation, 10(6), 799–822.

    Article  Google Scholar 

  • Lee, D., & Ott, C. (2011). Incremental kinesthetic teaching of motion primitives using the motion refinement tube. Autonomous Robots, 31(2–3), 115–131.

    Article  Google Scholar 

  • Levenson, R. W., Carstensen, L. L., Friesen, W. V., & Ekman, P. (1991). Emotion, physiology, and expression in old age. Psychology and Aging, 6(1), 28–35.

    Article  Google Scholar 

  • Looije, R., Neerincx, M. A., & Cnossen, F. (2010). Persuasive robotic assistant for health self-management of older adults: Design and evaluation of social behaviors. International Journal of Human-Computer Studies, 68(6), 386–397.

    Article  Google Scholar 

  • Lopez Recio, D., Marquez Segura, L., Marquez Segura, E. & Waern, A. (2013). The NAO models for the elderly. In: 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 187–188.

  • Matsusaka, Y., Fujii, H., Okano, T. & Hara, I. (2009). Health exercise demonstration robot TAIZO and effects of using voice command in robot-human collaborative demonstration. In: IEEE International Symposium on Robot and Human Interactive Communication, pp. 472–477.

  • Nakazawa, A., Nakaoka, S., Ikeuchi, K. & Yokoi, K. (2002). Imitating human dance motions through motion structure analysis. In: Proceedings of International Conference on Intelligent Robots and Systems, pp. 2539–2544.

  • Nguyen, V. V., & Lee, J. H . (2012). Full-body imitation of human motions with kinect and heterogeneous kinematic structure of humanoid robot. In: IEEE/SICE International Symposium on System Integration, pp. 93–98.

  • Ou, Y., Hu, J., Wang, Z., Fu, Y., Wu, X., & Li, X. (2015). A real-time human imitation system using kinect. International Journal of Social Robotics, 7(5), 587–600.

    Article  Google Scholar 

  • Pineau, J., Montemerlo, M., Pollack, M., Roy, N., & Thrun, S. (2003). Towards robotic assistants in nursing homes: Challenges and results. Robotics and Autonomous Systems, 42(3), 271–281.

    Article  MATH  Google Scholar 

  • Powell, M. (1998). Direct search algorithms for optimization calculations. Acta Numerica, 7, 287–336.

    MathSciNet  Article  MATH  Google Scholar 

  • Ros, R., Baroni, I., & Demiris, Y. (2014). Adaptive human-robot interaction in sensorimotor task instruction: From human to robot dance tutors. Robotics and Autonomous Systems, 62(6), 707–720.

    Article  Google Scholar 

  • Sharit, J., Czaja, S. J., Perdomo, D., & Lee, C. C. (2004). A cost-benefit analysis methodology for assessing product adoption by older user populations. Applied Ergonomics, 35(2), 81–92.

    Article  Google Scholar 

  • Shiomi, M., Iio, T., Kamei, K., Sharma, C., & Hagita, N. (2015). Effectiveness of social behaviors for autonomous wheelchair robot to support elderly people in Japan. PloS One, 10(5), e0128,031.

    Article  Google Scholar 

  • Smarr, C. A., Mitzner, T. L., Beer, J. M., Prakash, A., Chen, T. L., Kemp, C. C., et al. (2014). Domestic robots for older adults: attitudes, preferences, and potential. International Journal of Social Robotics, 6(2), 229–247.

    Article  Google Scholar 

  • Sucar, L., Azcárate, G., Leder, R., Reinkensmeyer, D., Hernández, J., Sanchez, I., et al. (2009). Gesture therapy: A vision-based system for arm rehabilitation after stroke. Biomedical Engineering Systems and Technologies International Joint Conference, BIOSTEC, Springer, Vol. 25, pp. 531–540.

  • Wainer, J., Feil-Seifer, D. J., Shell, D. A., & Mataric, M. J. (2007). Embodiment and human-robot interaction: A task-based perspective. In: The 16th IEEE International Symposium on Robot and Human interactive Communication, IEEE, pp. 872–877.

  • Wittenburg, P., Brugman, H., Russel, A., Klassmann, A. & Sloetjes, H. (2006). ELAN: A professional framework for multimodality research. In: Proceedings of LREC, pp. 1556–1559.

  • Wu, Y. H., Fassert, C., & Rigaud, A. S. (2012). Designing robots for the elderly: Appearance issue and beyond. Archives of Gerontology and Geriatrics, 54(1), 121–126.

    Article  Google Scholar 

  • Wu, Y. H., Wrobel, J., Cornuet, M., Kerhervé, H., Damnée, S. & Rigaud, A. S. (2014). Acceptance of an assistive robot in older adults: a mixed-method study of human-robot interaction over a 1-month period in the living lab setting. Clinical interventions in aging 9

  • Yoshikawa, Y., Shinozawa, K., Ishiguro, H., Hagita, N. & Miyamoto, N. (2006). The effects of responsive eye movement and blinking behavior in a communication robot. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4564–4569.

Download references

Acknowledgments

We are grateful to Okan Aşık for his comments on this work and his help with the observational studies. We further thank İbrahim Özcan for his help with the annotations. This work is supported in part by Boğaziçi University Research Fund through project 13A01P3.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Binnur Görer.

Additional information

This is one of several papers published in Autonomous Robots comprising the “Special Issue on Assistive and Rehabilitation Robotics”.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Görer, B., Salah, A.A. & Akın, H.L. An autonomous robotic exercise tutor for elderly people. Auton Robot 41, 657–678 (2017). https://doi.org/10.1007/s10514-016-9598-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10514-016-9598-5

Keywords

  • Robotic exercise tutor
  • Elderly-robot interaction
  • Imitation
  • Gesture
  • Gerontechnology