Abstract
We present an algorithm for real-time, robust, vision-based active tracking and pursuit. The algorithm was designed to overcome problems arising from active vision-based pursuit, such as target occlusion. Our method employs two layers to deal with occlusions of different lengths. The first layer is for short- or medium-term occlusions: those where a known method—such as mean shift combined with a Kalman filter—fails. For this layer we designed the hybrid filter for active pursuit (HAP). HAP utilizes a Kalman filter modified to respond to two different modes of action: one in which the target is positively identified and one in which the target identification is uncertain. For long-term occlusions we use the second layer. This layer is a decision algorithm that follows a learning procedure and is based on game theory-related reinforcement (Cesa-Bianchi and Lugosi, Prediction Learning and Games, 2006). The learning process is based on trial and error and is designed to perform adequately with a small number of samples. The algorithm produces a data structure that can be shared among agents or sent to a central control of a multi-agent system. The learning process is designed so that agents perform tasks according to their skills: an efficient agent will pursue targets while an inefficient agent will search for entering targets. These capacities make this system well suited for embedding in a multi-agent control system.
Similar content being viewed by others
References
Bar-Shalom, Y., Li, X.R., Kirubarajan, T.: Estimation with Applications to Tracking and Navigation. Wiley, New York (2001)
Comaniciu, D., Ramesh, V., Meer, P.: Real-time tracking of non-rigid objects using mean shift. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit. 2, 142–151 (2000)
Gustafsson, F., Gunnarsson, F., Bergman, N., Forssell, U., Jansson, J., Karlsson, R., Nordlund, P.J.: Particle filters for positioning, navigation and tracking. IEEE Trans. Signal Process. 50(2), 425–437 (2002)
Van Der Merwe, R., Wan, E.: The square-root unscented Kalman filter for state and parameter-estimation. IEEE Int. Conf. Acoust. Speech Signal Process. 6, 3461–3464 (2001)
Sinopoli, B., Schenato, L., Franceschetti, M., Poolla, K., Jordan, M.I., Sastry, S.S.: Kalman filtering with intermittent observations. IEEE Trans. Autom. Control 49(9), 1453–1464 (2004)
Cesa-Bianchi, N., Lugosi, G.: Prediction Learning and Games. Cambridge University Press, Cambridge (2006)
Rabiner, L.R., Juang, B.H.: An introduction to hidden Markov models. IEEE Acoust. Speech Signal Process. Mag. 3(1), 4–16 (1986)
Schapire, R.E.: A brief introduction to boosting. Int. Joint Conf. Artif. Intell. 16(2), 1401–1406 (1999)
Watkins, C.J.C.H., Dayan, P.: Q-learning. Mach. Learn. 8, 279–292 (1992)
Durham, W., Franchi, A., Bullo, F.: Distributed pursuit-evasion without mapping or global localization via local frontiers. Auton. Robots 32, 81–95 (2012)
Acknowledgments
The authors deeply thank Orly and Daniel Ghosalker for their contribution to the machine learning section, Daniel Sigalov for his constructive remarks, and Amir Geva for the programming of NEMALA. Gadi Katzir was supported during the writing by an ISF grant. Tomer Baum thanks Boreh Olam for everything.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Baum, T., Izhaki, I., Rivlin, E. et al. Active tracking and pursuit under different levels of occlusion: a two-layer approach. Machine Vision and Applications 25, 173–184 (2014). https://doi.org/10.1007/s00138-013-0520-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-013-0520-2