Generating Shared Latent Variables for Robots to Imitate Human Movements and Understand Their Physical Limitations

  • Maxime DevanneEmail author
  • Sao Mai Nguyen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11130)


Assistive robotics and particularly robot coaches may be very helpful for rehabilitation healthcare. In this context, we propose a method based on Gaussian Process Latent Variable Model (GP-LVM) to transfer knowledge between a physiotherapist, a robot coach and a patient. Our model is able to map visual human body features to robot data in order to facilitate the robot learning and imitation. In addition, we propose to extend the model to adapt the robots’ understanding to patients’ physical limitations during assessment of rehabilitation exercises. Experimental evaluation demonstrates promising results for both robot imitation and model adaptation according to patients’ limitations.


Robot imitation Transfer knowledge Physical rehabilitation Shared Gaussian Process Latent Variable Model Motion analysis 



The research work presented in this paper is partially supported by the EU FP7 grant ECHORD++ KERAAL, by the the European Regional Fund (FEDER) via the VITAAL Contrat Plan Etat Region and by project AMUSAAL funded by Region Brittany, France.


  1. 1.
    WHO Scientific Group on the Burden of Musculoskeletal Conditions at the Start of the New Millennium and others. World Health Organization Technical report series 919, i (2003)Google Scholar
  2. 2.
    Anderson, K., et al.: The TARDIS framework: intelligent virtual agents for social coaching in job interviews. In: Reidsma, D., Katayose, H., Nijholt, A. (eds.) ACE 2013. LNCS, vol. 8253, pp. 476–491. Springer, Cham (2013). Scholar
  3. 3.
    Belpaeme, T., et al.: Multimodal child-robot interaction: building social bonds. J. Hum.-Robot Interact. 1(2), 33–53 (2012)Google Scholar
  4. 4.
    Dariush, B., et al.: Online transfer of human motion to humanoids. Int. J. Human. Robot. (IJHR) 6(2), 265–289 (2009)CrossRefGoogle Scholar
  5. 5.
    Devanne, M., Mai, N.S.: Multi-level motion analysis for physical exercises assessment in Kinaesthetic rehabilitation. In: IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids), November 2017Google Scholar
  6. 6.
    Devanne, M., Nguyen, S.M., Remy-Neris, O., Le Gals-Garnett, B., Kermarrec, G., Thepaut, A.: A co-design approach for a rehabilitation robot coach for physical rehabilitation based on the error classification of motion errors. In: Second IEEE International Conference on Robotic Computing (IRC), January 2018Google Scholar
  7. 7.
    Fasola, J., Mataric, M.: A socially assistive robot exercise coach for the elderly. J. Hum.-Robot Interact. 2(2), 3–32 (2013)CrossRefGoogle Scholar
  8. 8.
    Görer, B., Salah, A.A., Akın, H.L.: A robotic fitness coach for the elderly. In: Augusto, J.C., Wichert, R., Collier, R., Keyson, D., Salah, A.A., Tan, A.-H. (eds.) AmI 2013. LNCS, vol. 8309, pp. 124–139. Springer, Cham (2013). Scholar
  9. 9.
    Gorer, B., Salah, A.A., Akın, H.L.: An autonomous robotic exercise tutor for elderly people. Auton. Robot. 41(3), 657–678 (2017)CrossRefGoogle Scholar
  10. 10.
    Kent, P., Kjaer, P.: The efficacy of targeted interventions for modifiable psychosocial risk factors of persistent nonspecific low back pain-a systematic review. Manual Ther. 17(5), 385–401 (2012)CrossRefGoogle Scholar
  11. 11.
    Koenemann, J., Burget, F., Bennewitz, M.: Real-time imitation of human whole-body motions by humanoids. In: IEEE International Conference on Robotics and Automation (ICRA), June 2014Google Scholar
  12. 12.
    Lapeyre, M.: Poppy: open-source, 3D printed and fully-modular robotic platform for science, art and education. Ph.D. thesis, Université de Bordeaux (2014)Google Scholar
  13. 13.
    Lawrence, N.D.: Gaussian process latent variable models for visualisation of high dimensional data. In: Advances in Neural Information Processing Systems, December 2006Google Scholar
  14. 14.
    Lawrence, N.D., Candela, J.Q.: Local distance preservation in the GP-LVM through back constraints. In: International Conference on Machine Leraning (ICML), December 2006Google Scholar
  15. 15.
    Obo, T., Loo, C.K., Kubota, N.: Imitation learning for daily exercise support with robot partner. In: 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 752–757. IEEE (2015)Google Scholar
  16. 16.
    Riley, C., Ude, A., Wade, K., Atkeson, C.: Enabling real-time full-body imitation: a natural way of transferring human movement to humanoids. In: IEEE International Conference on Robotics and Automation (ICRA), September 2003Google Scholar
  17. 17.
    Schneider, S., Kümmert, F.: Exercising with a humanoid companion is more effective than exercising alone. In: 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids), pp. 495–501. IEEE (2016)Google Scholar
  18. 18.
    Shon, A., Grochow, K., Hertzmann, A., Rao, R.P.: Learning shared latent structure for image synthesis and robotic imitation. In: 18th International Conference on Neural Information Processing Systems, December 2006Google Scholar
  19. 19.
    Stanton, C., Bogdanovych, A., Ratanasena, E.: Teleoperation of a humanoid robot using full-body motion capture, example movements, and machine learning. In: Australasian Conference on Robotics and Automation (ACRA), December 2012Google Scholar
  20. 20.
    Waltemate, T., Hülsmann, F., Pfeiffer, T., Kopp, S., Botsch, M.: Realizing a low-latency virtual reality environment for motor learning. In: Proceedings of ACM Symposium on Virtual Reality Software and Technology (VRST) (2015)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.IMT Atlantique, Lab-STICC, UBLBrestFrance

Personalised recommendations