Abstract
This paper addresses the problem of recognizing signs generated by a person to guide a robot. The proposed method is based on video color analysis of a moving person making signs. The analysis consists of segmentation of the middle body, arm and forearm location and recognition of the arm and forearm positions. The proposed method was experimentally tested on videos with different target colors and illumination conditions. Quantitative evaluations indicate 97.76% of correct detection of the signs in 1807 frames.
Chapter PDF
Similar content being viewed by others
References
Feil-Seifer, D.J., MatariÄ, M.: Human-Robot Interaction. In: Encyclopedia of Complexity and Systems Science, pp. 4643ā4659. Springer, New York (2009)
Khamis, A.M.: InteracciĆ³n Remota Con Robots MĆ³viles Basada En Internet, Universidad Carlos III de Madrid, Madrid, EspaƱa, Doctoral Thesis (2003)
Roger, C.: Asimovās Laws of Robotics: Implications for Information Technology Part 1. IEEE Computer SocietyĀ 22(12), 53ā61 (1993)
Draper, V.: Environmental Restoration and Waste Management Program Teleoperator Hand Controllers: Contextual Human Factors Assessment, OAK Ridge National Laboratory, Departamento de Energia de los Estados Unidos, Reporte (1994)
Hee-Deok, Y., A-Yeon, P., Seong-Whan, L.: Gesture Spotting and Recognition for Human-Robot Interaction. IEEE Transaction on RoboticsĀ 23(2), 256ā270 (2003)
Khan, I.R., Miyamoto, H.: Face and Arm-Posture Recognition for Secure Human-Machine Interaction. In: Systems, Man and Cybernetics, International Conference, pp. 411ā417 (2008)
Salti, S., Schreer, O., Stefano, D.: Real-time 3D Arm Pose Estimation from Monocular Video for Enhanced HCI. In: Proceeding of the 1st ACM Workshop on Vision Networks for Behavior Analysis, Vancouver, Canada, pp. 1ā8 (2008)
Siddiqui, M., Medioni, G.: Robust Real-Time Upper Body Limb Detection and Tracking. In: 4th ACM International Workshop on Video Surveillance & Sensor Networks, Santa Barbara, California, USA (2006)
Patrick, H., Mayank, B.: 3D Model Based Gesture Acquisition Using a Single Camera. In: Proceedings of the Sixth IEEE Workshop on Applications of Computer Vision, Orlando, Florida, pp. 158ā164 (2002)
Shaker, S., Saade, J., Asmar, D.: Fuzzy Inference-Based Person-Following Robot. International Journal of Systems Applications, Engineering and DevelopmentĀ 2(1), 29ā34 (2008)
Chen, H., Chen, T., Chen, Y., Lee, S.: Human Action Recognition Using Star Skeleton. In: 4th ACM International Workshop on Video Surveillance & Sensor Networks, Santa Barbara, California, USA (2006)
Tarokh, M., Kuo, J.: Vision Based Person Tracking and Following in Unstructured Environments. Department of Computer Science, San Diego State University, San Diego, California, U.S.A.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
Ā© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Saldivar-PiƱon, L., Chacon-Murguia, M.I., Sandoval-Rodriguez, R., Vega-Pineda, J. (2012). Human Sign Recognition for Robot Manipulation. In: Carrasco-Ochoa, J.A., MartĆnez-Trinidad, J.F., Olvera LĆ³pez, J.A., Boyer, K.L. (eds) Pattern Recognition. MCPR 2012. Lecture Notes in Computer Science, vol 7329. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31149-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-31149-9_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31148-2
Online ISBN: 978-3-642-31149-9
eBook Packages: Computer ScienceComputer Science (R0)