International Journal of Social Robotics

, Volume 2, Issue 2, pp 121–136

A Bank of Unscented Kalman Filters for Multimodal Human Perception with Mobile Service Robots


DOI: 10.1007/s12369-010-0047-x

Cite this article as:
Bellotto, N. & Hu, H. Int J of Soc Robotics (2010) 2: 121. doi:10.1007/s12369-010-0047-x


A new generation of mobile service robots could be ready soon to operate in human environments if they can robustly estimate position and identity of surrounding people. Researchers in this field face a number of challenging problems, among which sensor uncertainties and real-time constraints. In this paper, we propose a novel and efficient solution for simultaneous tracking and recognition of people within the observation range of a mobile robot. Multisensor techniques for legs and face detection are fused in a robust probabilistic framework to height, clothes and face recognition algorithms. The system is based on an efficient bank of Unscented Kalman Filters that keeps a multi-hypothesis estimate of the person being tracked, including the case where the latter is unknown to the robot. Several experiments with real mobile robots are presented to validate the proposed approach. They show that our solutions can improve the robot’s perception and recognition of humans, providing a useful contribution for the future application of service robotics.


Robot perception Human tracking and recognition Bayesian estimation Service robotics 

Copyright information

© Springer Science & Business Media BV 2010

Authors and Affiliations

  1. 1.School of Computer ScienceUniversity of LincolnLincolnUK
  2. 2.School of Computer Science and Electronic EngineeringUniversity of EssexColchesterUK

Personalised recommendations