Soft Computing

, Volume 21, Issue 2, pp 331–351 | Cite as

An empirical study on evaluating basic characteristics and adaptability to users of a preventive care system with learning communication robots

  • Daisuke Kitakoshi
  • Takuya Okano
  • Masato Suzuki


In many countries, and particularly in Japan, rising medical costs and shortfalls in the number of healthcare personnel are becoming serious national problems. This paper proposes a Preventive Care system with learning Communication robots (PrevCareCom), aiming to provide a preventive care approach wherein the elderly can engage in exercise over the long term without getting bored while communicating with robots through match-up games. In the PrevCareCom, the preventive care exercises are based on a simple, traditional Japanese match-up game, and several kinds of robots are used as opponents. The proposed system encourages a sense of familiarity with the robots (agents) for elderly users based on the concept of human–agent interaction. Reinforcement learning methods are also used to adapt system parameters such as exercise intensity and robot behavioral policy to the athletic performance of each user. Several experiments were carried out with the cooperation of local governments and health and welfare facilities to investigate characteristics of the PrevCareCom and to evaluate how well it adapts to its users in terms of familiarity, quality and quantity of exercise. The results of experiments showed that the users’ interest in the proposed system and sense of familiarity with the robots were encouraged by playing the game and interacting with the robots. Questionnaire results also showed that the PrevCareCom could provide appropriate exercise loads for the users’ care prevention.


Human–agent interaction Preventive care Communication robot Reinforcement learning 



We thank the staff and visitors of Higashi-asakawa, Minami-osawa, and Oyoko Health and Welfare Centers, and the staff of the Fujisawa Care Center for their cooperation.


  1. Acampora G, Gaeta M, Loia V, Vasilakos AV (2010) Interoperable and adaptive fuzzy services for ambient intelligence applications. ACM Trans Auton Adapt Syst 5(8):1–26. doi: 10.1145/1740600.1740604 CrossRefGoogle Scholar
  2. Borg G (1998) Borg’s perceived exertion and pain scales. Human Kinetics Pub, ChampaignGoogle Scholar
  3. Buchner DM, Cress ME, de Lateur BJ, Esselman PC, Margherita AJ, Price R, Wagner EH (1997) The effect of strength and endurance training on gait, balance, fall risk, and health services use in community-living older adults. J Gerontol A Biol Sci Med Sci 52A:M218–M224. doi: 10.1093/gerona/52A.4.M218 CrossRefGoogle Scholar
  4. Cassell J, Pelachaud C, Badler N, Steedman M, Achorn B, Becket T, Douville B, Prevost S, Stone M (1994) Animated conversation: rule-based generation of facial expression, gesture and spoken intonation for multiple conversational agents. In: Proceedings of 21st Annual Conf Comput Graph Interact Tech, pp 413–420Google Scholar
  5. de Melo CM, Zheng L, Gratch J (2009) Expression of moral emotions in cooperating agents. Lect Notes Comput Sci 5773:301–307CrossRefGoogle Scholar
  6. Faber MJ, Bosscher RJ, Paw MJCA, van Wieringen PC (2006) Effects of exercise programs on falls and mobility in frail and pre-frail older adults: a multicenter randomized controlled trial. Arch Phys Med Rehabil 87:885–896CrossRefGoogle Scholar
  7. Grefenstette JJ (1988) Credit assignment in rule discovery systems based on genetic algorithms. Mach Learn 3:225–245Google Scholar
  8. Kessous L, Castellano G, Caridakis G (2010) Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis. J Multimodal User Interface 3:33–48CrossRefGoogle Scholar
  9. Kidd C, Breazeal C (2004) Effect of a robot on user perceptions. In: Proc IEEE/RSJ int conf intell robots systems, pp 3559–3564Google Scholar
  10. Kitakoshi D, Shioya H, Nakano R (2010) Empirical analysis of an on-line adaptive system using a mixture of Bayesian networks. Inf Sci 180:2856–2874. doi: 10.1016/j.ins.2010.04.001 MathSciNetCrossRefGoogle Scholar
  11. Lee CS, Wang MH, Hagas H, Chen ZW, Lan ST, Kuo SE, Kuo HC, Cheng HH (2012) A novel genetic fuzzy markup language and its application to healthy diet assessment. Int J Uncertain Fuzziness Knowl Syst 20(2):247–278. doi: 10.1142/S0218488512400235 CrossRefGoogle Scholar
  12. Lee CS, Wang MH, Wu MJ, Nakagawa Y, Tsuji H, Yamazaki Y, Hirota K (2013) Soft-computing-based emotional expression mechanism for game of computer Go. Soft Comput 17:1263–1282CrossRefGoogle Scholar
  13. Lee CS, Wang MH, Wu MJ, Teytaud O, Yen SJ (2014) T2FS-based adaptive linguistic assessment system for semantic analysis and human performance evaluation on game of Go. IEEE Trans Fuzzy Syst. doi: 10.1109/TFUZZ.2014.2312989 Google Scholar
  14. Ministry of Health, Labour and Welfare (2011) Comprehensive survey of living conditions. Accessed 22 May 2013. (in Japanese)
  15. Ministry of Health, Labour and Welfare (2012) Manual for prevention of long-term care (revised version). (in Japanese)Google Scholar
  16. Miyazaki K, Kobayashi S (1999) On the rationality of profit sharing in partially observable Markov decision processes. In: Proceedings of 5th int conf inf syst analysis and synthesis, pp 190–197Google Scholar
  17. Miyazaki K, Kobayashi S (2001) Rationality of reward sharing in multi-agent reinforcement learning. New Gener Comput 19:157–172CrossRefzbMATHGoogle Scholar
  18. Niewiadomski R, Hyniewska SJ, Pelachaud C (2011) Constraint based model for synthesis of multimodal sequential expressions of emotions. IEEE Trans Affect Comput 2:134–146Google Scholar
  19. Obuchi S, Shibata H, Yasumura S, Suzuki T (1994) Relationship between walking ability and risk of falls in community dwelling elderly in Japan. J Phys Ther Sci 6:39–44Google Scholar
  20. Pelachaud C (2009) Modelling multimodal expression of emotion in a virtual agent. Philos Trans R Soc B 364:3539–3548CrossRefGoogle Scholar
  21. Phinyomark A, Chujit G, Phukpattaranont P, Limsakul C, Hu H (2012) A preliminary study assessing time-domain EMG features of classifying exercises in preventing falls in the elderly. In: Proceedings of 2012 9th int conf electr eng/electr, computer, telecommun inf, pp 1–4Google Scholar
  22. Phommasak U, Kitakoshi D, Mao J, Shioya H (2014) A policy-improving system for adaptability to dynamic environments using mixture probability and clustering distribution. J Comput Commun 2:210–219. doi: 10.4236/jcc.2014.24028 CrossRefGoogle Scholar
  23. Powers A, Kiesler S, Fussell S, Torrey C (2007) Comparing a computer agent with a humanoid robot. In: Proc ACM/IEEE int conf hum-robot interact, pp 145–152Google Scholar
  24. Rosenthal S, Biswas J, Veloso M (2010) An effective personal mobile robot agent through symbiotic human–robot interaction. In: Proceedings of int conf auton agents multiagent syst, pp 915–912Google Scholar
  25. Shibano T, Ho Y, Kono Y, Fujimoto Y, Yamaguchi T (2010) Daily support system for care prevention by using interaction monitoring robot. In: Proceedings of int conf intell robot syst, pp 3477–3482. doi: 10.1109/IROS.2010.5653582
  26. Shimada T, Uchiyama Y, Kakurai S (2003) Specific effects of balance and gait exercises on physical function among the frail elderly. Clin Rehabil 17:472–479CrossRefGoogle Scholar
  27. Sumi K, Ebata R (2013) Human–agent interaction for learning service-minded communication. In: Proceedings of 1st international conference on HAI, III-3-3Google Scholar
  28. Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, CambridgeGoogle Scholar
  29. Suzuki T, Kim H, Yoshida H, Ishizaki T (2004) Randomized controlled trial of exercise intervention for the prevention of falls in community-dwelling elderly Japanese women. J Bone Miner Metab 22:602–611CrossRefGoogle Scholar
  30. Tan SCG, Nareyek A (2009) Integrating facial, gesture, and posture emotion expression for a 3D virtual agent. In: Proceedings of 14th int conf comput games: AI, animat, mob, interact multimed, educ serious games, pp 23–31Google Scholar
  31. The LEGO Group (2012) MINDSTORMS. Accessed 12 July 2012
  32. Tanaka F, Cicourel A, Movellan JR (2007) Socialization between toddlers and robots at an early childhood education center. Proc Natl Acad Sci USA 104:17954–17958CrossRefGoogle Scholar
  33. United Nations (2013) World population prospects: the 2012 revision. Accessed 1 June 2013
  34. Yaghoubzadeh R, Kopp S (2011) Creating familiarity through adaptive behavior generation in human–agent interaction. Lect Notes Comput Sci 6895:195–201CrossRefGoogle Scholar
  35. Yamazaki Y, Hatakeyama Y, Dong F, Nomoto K, Hirota K (2008) Fuzzy inference based mentality expression for eye robot in affinity pleasure–arousal space. J Adv Comput Intell Intell Inform 12(3):304–313Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2015

Authors and Affiliations

  • Daisuke Kitakoshi
    • 1
  • Takuya Okano
    • 2
  • Masato Suzuki
    • 1
  1. 1.Department of Computer ScienceTokyo National College of TechnologyTokyoJapan
  2. 2.Dai Nippon Printing Company LimitedTokyoJapan

Personalised recommendations