Improving People Awareness of Service Robots by Semantic Scene Knowledge

  • Jörg Stückler
  • Sven Behnke
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6556)


Many mobile service robots operate in close interaction with humans. Being constantly aware of the people in the surrounding of the robot thus poses an important challenge to perception and behavior design.

In this paper, we present an approach to people awareness for mobile service robots that utilizes knowledge about the semantics of the environment. The known semantics, e.g., about walkable floor, chairs, and shelves, provides the robot with prior information. We utilize information about the a-priori likelihood that people are present at semantically distinct places. Together with reasonable face heights inferred from scene semantics, this information supports robust detection and awareness of people in the robot’s environment. For efficient exploration of the environment for people, we propose a strategy which chooses search locations that maximize the expected detection rate of new persons.

We evaluate our approach with our domestic service robot that competes in the RoboCup@Home league.


Service Robot False Positive Detection Face Height Presence Probability Laser Range Scan 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Schulz, D., Burgard, W., Fox, D., Cremers, A.B.: People tracking with a mobile robot using sample-based joint probabilistic data association filters. International Journal of Robotics Research 22 (2003)Google Scholar
  2. 2.
    Arras, K., Grzonka, S., Luber, M., Burgard, W.: Efficient people tracking in laser range data using a multi-hypothesis leg-tracker with adaptive occlusion probabilities. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Pasadena, CA, USA (2008)Google Scholar
  3. 3.
    Reid, D.B.: An algorithm for tracking multiple targets. IEEE Transactions on Automatic Control 24(6) (1979)Google Scholar
  4. 4.
    Berclaz, J., Fleuret, F., Fua, P.: Robust People Tracking with Global Trajectory Optimization. In: Proc. of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), pp. 744–750 (2006)Google Scholar
  5. 5.
    Lanz, O.: Approximate bayesian multibody tracking. IEEE Trans. Pattern Anal. Mach. Intell. 28(9), 1436–1449 (2006)CrossRefGoogle Scholar
  6. 6.
    Gavrila, D.M., Munder, S.: Multi-cue pedestrian detection and tracking from a moving vehicle. Int. Journal of Computer Vision 73(1), 41–59 (2007)CrossRefGoogle Scholar
  7. 7.
    Ess, A., Leibe, B., Schindler, K., van Gool, L.: A mobile vision system for robust multi-person tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (June 2008)Google Scholar
  8. 8.
    Okuma, K., Taleghani, A., de Freitas, N., Little, J.J., Lowe, D.G.: A boosted particle filter: Multitarget detection and tracking. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 28–39. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  9. 9.
    Wu, B., Nevatia, R.: Detection and tracking of multiple, partially occluded humans by bayesian combination of edgelet based part detectors. International Journal of Computer Vision 75(2), 247–266 (2007)CrossRefGoogle Scholar
  10. 10.
    Luber, M., Tipaldi, G.D., Arras, K.O.: Spatially grounded multi-hypothesis tracking of people. In: Proceedings of the ICRA Workshop on People Detection and Tracking (2009)Google Scholar
  11. 11.
    Kuhn, H.W.: The hungarian method for the assignment problem. Naval Research Logistics Quarterly 2(1), 83–97 (1955)MathSciNetCrossRefzbMATHGoogle Scholar
  12. 12.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2001)Google Scholar
  13. 13.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: International Conference on Computer Vision & Pattern Recognition, vol. 2, pp. 886–893 (June 2005)Google Scholar
  14. 14.
    Thrun, S., Burgard, W., Fox, D.: Probabilistic Robotics. MIT Press, Cambridge (2005)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Jörg Stückler
    • 1
  • Sven Behnke
    • 1
  1. 1.Computer Science Institute VI, Autonomous Intelligent SystemsUniversity of BonnBonnGermany

Personalised recommendations