Abstract
People detection and tracking is a key issue for social robot design and effective human robot interaction. This paper addresses the problem of detecting people with a mobile robot using a stereo camera. People detection using mobile robots is a difficult task because in real world scenarios it is common to find: unpredictable motion of people, dynamic environments, and different degrees of human body occlusion. Additionally, we cannot expect people to cooperate with the robot to perform its task. In our people detection method, first, an object segmentation method that uses the distance information provided by a stereo camera is used to separate people from the background. The segmentation method proposed in this work takes into account human body proportions to segment people and provides a first estimation of people location. After segmentation, an adaptive contour people model based on people distance to the robot is used to calculate a probability of detecting people. Finally, people are detected merging the probabilities of the contour people model and by evaluating evidence over time by applying a Bayesian scheme. We present experiments on detection of standing and sitting people, as well as people in frontal and side view with a mobile robot in real world scenarios.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Burgard, W., Cremers, A., Fox, D., Hähnel, D., Lakemeyer, G., Schulz, D., Steiner, W., Thrun, S.: Experiences with an Interactive Museum Tour-guide Robot. Artificial Intelligence, 3–55 (1999)
Osada, J., Ohnaka, S., Sato, M.: The Scenario and Design Process of Childcare Robot, PaPeRo, pp. 80–86 (2006)
Gharpure, C.P., Kulyukin, V.A.: Robot-assisted Shopping for the Blind: Issues in Spatial Cognition and Product Selection. Intelligent Service Robotics 1(3), 237–251 (2008)
Forlizzi, J., DiSalvo, C.: Service robots in the domestic environment: a study of the roomba vacuum in the home. In: Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-robot Interaction, Salt Lake City, Utah, USA, pp. 258–265 (2006)
Montemerlo, M., Pineau, J., Roy, N., Thrun, S., Verma, V.: Experiences with a Mobile Robotic Guide for the Elderly. In: Proceedings of the 18th national conference on Artificial intelligence, Edmonton, Alberta, Canada, pp. 587–592 (2002)
Gockley, R., Forlizzi, J., Simmons, R.: Interactions with a Moody Robot. In: Interactions with a Moody Robot, pp. 186–193. ACM, New York (2006)
Malagón-Borja, L., Fuentes, O.: Object Detection Using Image Reconstruction with PCA. Image Vision Computing 27, 2–9 (2009)
Cielniak, G., Duckett, T.: People Recognition by Mobile Robots. Journal of Intelligent and Fuzzy Systems: Applications in Engineering and Technology 15(1), 21–27 (2004)
Davis-James, W., Sharma, V.: Robust Detection of People in Thermal Imagery. In: Proceedings of 17th International Conference on the Pattern Recognition ICPR 2004, pp. 713–716 (2004)
Müller, S., Schaffernicht, E., Scheidig, A., Hans-Joachim, B., Gross-Horst, M.: Are You Still Following Me? In: Proceedings of the 3rd European Conference on Mobile Robots ECMR, Germany, pp. 211–216 (2007)
Darrell, T.J., Gordon, G., Harville, M., Iselin-Woodfill, J.: Integrated Person Tracking Using Stereo, Color, and Pattern Detection. International Journal of Computer Vision, 175–185 (2000)
Vinay, S., James, W.D.: Extraction of Person Silhouettes from Surveillance Imagery using MRFs. In: Proceedings of the Eighth IEEE Workshop on Applications of Computer Vision, p. 33 (2007)
Ahn, J.-H., Byun, H.: Human Silhouette Extraction Method Using Region Based Background Subtraction. LNCS, pp. 412–420. Springer, Berlin (2007)
Lee, L., Dalley, G., Tieu, K.: Learning Pedestrian Models for Silhouette Refinement. In: Proceedings of the 19th IEEE International Conference on Computer Vision, Nice, France, pp. 663–670 (2003)
Schaffernicht, E., Martin, C., Scheidig, A., Gross, H.-M.: A Probabilistic Multimodal Sensor Aggregation Scheme Applied for a Mobile Robot. In: Proceedings of the 28th German Conference on Artificial Intelligence, Koblenz, Germany, pp. 320–334 (2005)
Bellotto, N., Hu, H.: Vision and Laser Data Fusion for Tracking People with a Mobile Robot. In: International Conference on Robotics and Biomimetics ROBIO 2006, Kunming, China, pp. 7–12 (2006)
Siddiqui, M., Medioni, G.: Robust real-time upper body limb detection and tracking. In: Proceedings of the 4th ACM International Workshop on Video Surveillance and Sensor Networks VSSN 2006, Santa Barbara, California, USA, pp. 53–60 (2006)
Wilhelm, T., Bohme, H.-J., Gross, H.-M.: Sensor Fusion for Visual and Sonar based People Tracking on a Mobile Service Robot. In: Proceedings of the International Workshop on Dynamic Perception 2002, Bochum, Germany, pp. 315–320 (2002)
Lastra, A., Pretto, A., Tonello, S., Menegatti, E.: Robust Color-Based Skin Detection for an Interactive Robot. In: Proceedings of the 10th Congress of the Italian Association for Artificial Intelligence (AI*IA 2007), Roma, Italy, pp. 507–518 (2007)
Han, J., Bhanu, B.: Fusion of Color and Infrared Video for Dynamic Indoor Environment Human Detection. Pattern Recognition 40(6), 1771–1784 (2007)
Muñoz-Salinas, R., Aguirre, E.: People Detection and Tracking Using Stereo Vision and Color. Image Vision Computing 25(6), 995–1007 (2007)
Viola, P., Jones, M.J.: Robust Real-time Object Detection, Robust Real-time Object Detection. Cambridge Research Laboratory 24 (2001)
Lowe, D.G.: Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Canny, F.: A computational approach to edge detection. IEEE Trans. Pattern Analysis and Machine Intelligence 8(6), 679–698 (1986)
Treptow, A., Cielniak, G., Ducket, T.: Active People Recognition using Thermal and Grey Images on a Mobile Security Robot. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Edmonton, Alberta, Canada (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Méndez-Polanco, J.A., Muñoz-Meléndez, A., Morales, E.F. (2009). People Detection by a Mobile Robot Using Stereo Vision in Dynamic Indoor Environments. In: Aguirre, A.H., Borja, R.M., Garciá, C.A.R. (eds) MICAI 2009: Advances in Artificial Intelligence. MICAI 2009. Lecture Notes in Computer Science(), vol 5845. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-05258-3_31
Download citation
DOI: https://doi.org/10.1007/978-3-642-05258-3_31
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-05257-6
Online ISBN: 978-3-642-05258-3
eBook Packages: Computer ScienceComputer Science (R0)