Human Detection in Indoor Environments Using Multiple Visual Cues and a Mobile Robot

  • Stefan Pszczółkowski
  • Alvaro Soto
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4756)


In order to deploy mobile robots in social environments like indoor buildings, they need to be provided with perceptual abilities to detect people. In the computer vision literature the most typical solution to this problem is based on background subtraction techniques, however, in the case of a mobile robot this is not a viable solution. This paper shows an approach to robustly detect people in indoor environments using a mobile platform. The approach uses a stereo vision system that yields a stereo pair from which a disparity image is obtained. From this disparity image, interesting objects or blobs are segmented using a region growing algorithm. Afterwards, a color segmentation algorithm is performed on each blob, searching for human skin color areas. Finally, a probabilistic classifier provides information to decide if a given skin region corresponds to a human. We test the approach by mounting the resulting system on a mobile robot that navigates in an office type indoor building. We test the system under real time operation and different illumination conditions. The results indicate human detection accuracies over 90% in our test.


human detection human-computer interaction face detection 


  1. 1.
    Baggenstoss, P.M.: Statistical modeling using gaussian mixtures and HMMs with MATLAB. Naval Undersea Warfare Center, Newport, RI (2002),
  2. 2.
    Castleman, K.R.: Digital image processing. Prentice-Hall, Englewood Cliffs (1996)Google Scholar
  3. 3.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 886–893. IEEE Computer Society Press, Los Alamitos (2005)Google Scholar
  4. 4.
    Darrell, T., Gordon, G., Harville, M., Woodfill, J.: Integrated person tracking using stereo, color, and pattern detection. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 601–608. IEEE Computer Society Press, Los Alamitos (1998)Google Scholar
  5. 5.
    Flusser, J., Suk, T.: Pattern recognition by affine moment invariants. Pattern Recognition 26(1), 167–174 (1993)CrossRefMathSciNetGoogle Scholar
  6. 6.
    Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robotics and Autonomous Systems, Special issue on Socially Interactive Robots 42(3-4), 143–166 (2003)zbMATHGoogle Scholar
  7. 7.
    Hu, M.K.: Visual pattern recognition by moment invariants. IRE Trans. Info. Theory IT(8), 179–187 (1962)Google Scholar
  8. 8.
    Konolige, K.: Small vision system: Hardware and implementation. In: Eighth Symposium on Robotics Research, pp. 111–116 (1997)Google Scholar
  9. 9.
    Ogale, N.A.: A survey of techniques for human detection from video. Master’s thesis, University of Maryland (May 2006)Google Scholar
  10. 10.
    Sidenbladh, H.: Detecting human motion with support vector machines. In: ICPR 2004, vol. 2, pp. 188–191 (2004)Google Scholar
  11. 11.
    Utsumi, A., Tetsutani, N.: Human detection using geometrical pixel value structures. In: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, p. 39. IEEE Computer Society Press, Los Alamitos (2002)CrossRefGoogle Scholar
  12. 12.
    Viola, P., Jones, M.J., Snow, D.: Detecting pedestrians using patterns of motion and appearance. In: Proceedings of the Ninth IEEE International Conference on Computer Vision, pp. 734–741. IEEE Computer Society Press, Los Alamitos (2003)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Stefan Pszczółkowski
    • 1
  • Alvaro Soto
    • 1
  1. 1.Pontificia Universidad Catolica de Chile, Santiago 22Chile

Personalised recommendations