Useful Computer Vision Techniques for Human-Robot Interaction

  • O. Deniz
  • A. Falcon
  • J. Mendez
  • M. Castrillon
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3212)


This paper describes some simple but useful computer vision techniques for human-robot interaction. First, an omnidirectional camera setting is described that can detect people in the surroundings of the robot, giving their angular positions and a rough estimate of the distance. The device can be easily built with inexpensive components. Second, we comment on a color-based face detection technique that can alleviate skin-color false positives. Third, a simple head nod and shake detector is described, suitable for detecting affirmative/negative, approval/dissaproval, understanding/disbelief head gestures.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robotics and Autonomous Systems 42 (2003)Google Scholar
  2. 2.
    Liu, X., Zhao, Y., Pi, X., Liang, L., Nefian, A.: Audio-visual continuous speech recognition using a coupled Hidden Markov Model. In: IEEE Int. Conference on Spoken Language Processing, pp. 213–216 (2002)Google Scholar
  3. 3.
    McCowan, I.: Robust speech recognition using microphone arrays. PhD thesis, Queensland University of Technology, Australia (2001) Google Scholar
  4. 4.
    Deniz, O., Castrillon, M., Lorenzo, J., Guerra, C., Hernandez, D., Hernandez, M.: CASIMIRO: A robot head for human-computer interaction. In: Proceedings of 11th IEEE International Workshop on Robot and Human Interactive Communication (ROMAN 2002), Berlin, Germany (2002)Google Scholar
  5. 5.
    Castrillon, M.: On Real-Time Face Detection inVideo Streams. An Opportunistic Approach. PhD thesis, Universidad de Las Palmas de Gran Canaria (2003) Google Scholar
  6. 6.
    Darrell, T., Gordon, G., Harville, M., Woodfill, J.: Integrated person tracking using stereo, color, and pattern detection. In: Procs. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Santa Barbara, CA, pp. 601–608 (1998)Google Scholar
  7. 7.
    Moreno, F., Andrade-Cetto, J., Sanfeliu, A.: Localization of human faces fusing color segmentation and depth from stereo (2001) Google Scholar
  8. 8.
    Grange, S., Casanova, E., Fong, T., Baur, C.: Vision based sensor fusion for human-computer interaction (2002) Google Scholar
  9. 9.
    Kapoor, A., Picard, R.: A real-time head nod and shake detector (2001) Google Scholar
  10. 10.
    Davis, J., Vaks, S.: A perceptual user interface for recognizing head gesture acknowledgements. In: Proc. of ACM Workshop on Perceptual User Interfaces, Orlando, Florida (2001) Google Scholar
  11. 11.
    Bouguet, J.: Pyramidal implementation of the Lucas Kanade feature tracker. Technical report, Intel Corporation, Microprocessor Research Labs, OpenCV documents (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • O. Deniz
    • 1
  • A. Falcon
    • 1
  • J. Mendez
    • 1
  • M. Castrillon
    • 1
  1. 1.Departamento de Informática y Sistemas, Edificio de Informática y Matemáticas. Campus de TafiraUniversidad de Las Palmas de Gran CanariaLas PalmasSpain

Personalised recommendations