CONTROLO 2016 pp 373-383 | Cite as

Imitate Me!—Preliminary Tests on an Upper Members Gestures Recognition System

  • Vinícius Silva
  • Pedro Leite
  • Filomena Soares
  • João Sena EstevesEmail author
  • Sandra Costa
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 402)


This work describes the design, implementation, and preliminary tests of a system that uses a humanoid robot to mimic non-standard upper members gestures of a human body. The final goal is to use the robot as a mediator in motor imitation activities with children with special needs, either cognitive or motor impairments. A Kinect sensor and the humanoid robot ZECA (a Zeno R-50 robot from Hanson RoboKind) are used to identify and mimic upper members gestures. The system allows direct control of the humanoid robot by the user. The proposed system was tested in laboratory environment with adults with typical development. Furthermore, the system was tested with three children between 4 and 12 years old with motor and cognitive difficulties in a clinical-like environment. The main goal of these preliminary tests was to detect the constraints of the system.


Human-Robot interaction Kinect Upper members gestures recognition Zeno 



This work has been supported by COMPETE: POCI-01-0145-FEDER-007043 and FCT—Fundação para a Ciência e Tecnologia within the Project Scope: UID/CEC/00319/2013.


  1. 1.
    Liu, H.Y., Wang, W.J., Wang, R.J., Tung, C.W., Wang, P.J., Chang, I.P.: Image recognition and force measurement application in the humanoid robot imitation. IEEE Trans. Instrum. Meas. 61(1), 149–161 (2012)CrossRefGoogle Scholar
  2. 2.
    Nguyen, V.V., Lee, J.-H.: Full-body imitation of human motions with Kinect and heterogeneous kinematic structure of humanoid robot. In: IEEE/SICE International Symposium on System Integration (SII). Fukuoka, pp. 93−98, 16–18 Dec 2012Google Scholar
  3. 3.
    Manasrah, A.A.: Human motion tracking for assisting balance. Master Thesis, University of South Florida, Florida (2012)Google Scholar
  4. 4.
    Billard, B.R., Nadel, J., Dautenhahn, K.: Building Robota, a mini-humanoid robot for the rehabilitation of children with autism. RESNA Assist. Technol. J. 1–5 (2006)Google Scholar
  5. 5.
    Yihong, C., Qijun, C.: Real-time imitation human upper-body movement with joint and self-collision constraints. In: 2013 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM), Manila, 12–15 Nov 2013Google Scholar
  6. 6.
    Teachasrisaksakul, K., Zhang, Z., Yang, G.-Z.: Demo abstract: upper limb motion imitation module for humanoid robot using biomotion + sensors. In: IEEE International Conference on Body Sensor Networks (BSN), Cambridge, MA, USA, 6–9 May 2013Google Scholar
  7. 7.
    Guizzo, E.: Humanoid robot Mahru mimics a person’s movements in real time (2010). IEEE Spectrum. Accessed on July 2015
  8. 8.
    Aldebaran Robotics NAO. (2015). From Active Robots: Accessed on July 2015
  9. 9.
    Mahru Humanoid Robot Real-Time Teleoperation. From Youtube: Accessed on July 2015
  10. 10.
    Kinect the technology (2015). Accessed on July 2015
  11. 11.
    Kinect for Windows Sensor Components and Specifications (2015). Accessed on July 2015
  12. 12.
    Arngren (2015). Accessed on July 2015
  13. 13.
    Coordinate Spaces (2015). Accessed on July 2015
  14. 14.
    Joint Filtering (2015). Accessed on July 2015
  15. 15.
    Torres, N.A., Clark, N., Ranatunga, I., Popa, D.: Implementation of interactive arm playback behaviors of social robot zeno for autism spectrum disorder therapy. In: PETRA2012—Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments, Crete, Greece (2012)Google Scholar
  16. 16.
    Weisstein, E.W.: Rotation Matrix (2015). Accessed on 05 Jul 2015
  17. 17.
    R50 Documentation (2015). Accessed on July 2015

Copyright information

© Springer International Publishing Switzerland 2017

Authors and Affiliations

  • Vinícius Silva
    • 1
  • Pedro Leite
    • 1
  • Filomena Soares
    • 2
  • João Sena Esteves
    • 2
    Email author
  • Sandra Costa
    • 1
  1. 1.Industrial Electronics DepartmentUniversity of MinhoGuimarãesPortugal
  2. 2.Industrial Electronics Department, R&D Centre Algoritmi School of EngineeringUniversity of MinhoGuimarãesPortugal

Personalised recommendations