Using Gesture-Based Interfaces to Control Robots

  • Gabriel M. BandeiraEmail author
  • Michaela Carmo
  • Bianca Ximenes
  • Judith Kelner
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9170)


This paper analyzes human-robot interaction (HRI) to evaluate whether the use of a gesture-based interface is viable for robot control. An experiment was conducted with 19 volunteers. Using a body tracking device, they had to perform gestural commands to remotely control a mobile robot and complete a path marked on the floor. After the experiment, volunteers answered a questionnaire assessing aspects such as system’s responsiveness, precision, and triggers to possible physical and psychological discomforts.

The results achieved validated the research aim partially, as it was determined that this control method is viable but only for short-term operations, pointing a necessity to create a more suitable control, less prone to cause user fatigue during long-term use. The developed system was designed not only for the analysis of HRI factors, but also for applications in remote operation contexts, such as industrial maintenance and exploration of inhospitable environments.


Human-robot interaction Human-computer interaction Natural interfaces Gestural interfaces Remote operated robotics Validation 


  1. 1.
    Singh, A., Seo, S.H., Hashish, Y., Nakane, M., Young, J.E., Bunt, A.: An interface for remote robotic manipulator control that reduces task load and fatigue. In: Proceedings IEEE International Work. Robot Hum. Interact. Commun., pp. 738–743 (2013)Google Scholar
  2. 2.
    Tanzini, M., Tripicchio, P., Ruffaldi, E., Galgani, G., Lutzemberger, G., Avizzano, C.A.: A novel human-machine interface for working machines operation. In: Proceedings IEEE International Workshop on Robot Human Communication, pp. 744–750 (2013)Google Scholar
  3. 3.
    Mayora-Ibarra, O., Sucar, E., Aviles, H., Miranda-Palma, C.: From HCI to HRI - Usability inspection in multimodal human - Robot interactions. In: Proceedings IEEE International Workshop on Robot and Human Interactive Communication, pp. 37–41 (2003)Google Scholar
  4. 4.
    Rao, A., Kumar, S., Renu, A., Nandi, G.C.: MILO - mobile intelligent Linux robot. In: Proceedings IEEE INDICON 2004. First India Annual Conference 2004 (2004)Google Scholar
  5. 5.
    Shackel, B., Richardson, S.J.: Human Factors for Informatics Usability. Cambridge UP, Cambridge (1991). PrintGoogle Scholar
  6. 6.
    de Souza, C.S., Leite, J.C., Prates, R.O., Barbosa, S.D.J.: Interação Humano-Computador: Perspectivas Cognitivas e Semióticas. In: Fuks, H. (Org.) Anais das Jornadas de Atualização em Informática. Rio de Janeiro: Edições EntreLugar, 1999, pp. 420–470 (1999)Google Scholar
  7. 7.
    Wigdor, D., Wixon, D.: Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Elsevier Science, USA (2011)Google Scholar
  8. 8.
    Walker, R., Bartneck, C.: The pleasure of receiving a head massage from a robot. In: Proceedings IEEE International Workshop on Robot and Human Interactive Communication, pp. 807–813 (2013)Google Scholar
  9. 9.
    De Graaf, M.M.A., Ben Allouch, S.: The relation between peoples attitude and anxiety towards robots in human-robot interaction. In: Proceedings International Workshop on Robot and Human Interactive Communication, pp. 632–637 (2013)Google Scholar
  10. 10.
    Wei, J.W.J., Qin, H.Q.H., Guo, J.G.J., Chen, Y.C.Y.: The hand shape recognition of Human Computer Interaction with Artificial Neural Network. In: 2009 IEEE International Conference Human-Computer Interfaces, and Measurement System 04 (2009)Google Scholar
  11. 11.
    Cho, N.-G., Lee, S.-W.: Incorporating global and local observation models for human pose tracking. RO-MAN, 2013 IEEE, pp. 25–30 (2013)Google Scholar
  12. 12.
    Prates, R., Barbosa, S.: Avaliação de Interfaces de UsuárioConceitos e Métodos. An. do XXIII Congress, p. 14 (2003)Google Scholar
  13. 13.
    Prates, R.O., Barbosa, S.D.J.: Introdução Teoria e Prática da Interação Humano Computador fundamentada na Engenharia Semiótica. Jornadas de Atualização em Informática, JAI 2007, pp. 263–326 (2007)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Gabriel M. Bandeira
    • 1
    Email author
  • Michaela Carmo
    • 2
  • Bianca Ximenes
    • 1
  • Judith Kelner
    • 1
  1. 1.Centro de Informática (CIn) - Universidade Federal de Pernambuco (UFPE)RecifeBrazil
  2. 2.Universidade de Pernambuco (UPE)RecifeBrazil

Personalised recommendations