State-Driven Particle Filter for Multi-person Tracking

  • David Gerónimo Gomez
  • Frédéric Lerasle
  • Antonio M. López Peña
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7517)


Multi-person tracking can be exploited in applications such as driver assistance, surveillance, multimedia and human-robot interaction. With the help of human detectors, particle filters offer a robust method able to filter noisy detections and provide temporal coherence. However, some traditional problems such as occlusions with other targets or the scene, temporal drifting or even the lost targets detection are rarely considered, making the systems performance decrease. Some authors propose to overcome these problems using heuristics not explained and formalized in the papers, for instance by defining exceptions to the model updating depending on tracks overlapping. In this paper we propose to formalize these events by the use of a state-graph, defining the current state of the track (e.g., potential, tracked, occluded or lost) and the transitions between states in an explicit way. This approach has the advantage of linking track actions such as the online underlying models updating, which gives flexibility to the system. It provides an explicit representation to adapt the multiple parallel trackers depending on the context, i.e., each track can make use of a specific filtering strategy, dynamic model, number of particles, etc. depending on its state. We implement this technique in a single-camera multi-person tracker and test it in public video sequences.


Particle Filter Data Association Track Model Generalize Likelihood Ratio Test Generalize Likelihood Ratio 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Negre, A., Tran, H., Gourier, N., Hall, D., Lux, A., Crowley, J.L.: Comparative study of people detection in surveillance scenes. In: International Workshop on Structural and Syntactic Pattern Recognition, Kyoto, Japan (2006)Google Scholar
  2. 2.
    Gerónimo, D., López, A., Sappa, A., Graf, T.: Survey of pedestrian detection for advanced driver assistance systems. TPAMI 32(7), 1239–1258 (2010)CrossRefGoogle Scholar
  3. 3.
    Germa, T., Lerasle, F., Ouadah, N., Cadenat, V.: Vision and RFID data fusion for tracking people in crowds by a mobile robot. Computer Vision and Image Unterstanding 114(6), 641–651 (2010)CrossRefGoogle Scholar
  4. 4.
    Isard, M., Blake, A.: CONDENSATION – conditional density propagation for visual tracking. IJCV 29(1), 5–28 (1998)CrossRefGoogle Scholar
  5. 5.
    Isard, M., Blake, A.: ICONDENSATION: Unifying low-level and high-level tracking in a stochastic framework. In: ICCV, Freiburg, Germany, pp. 893–908 (1998)Google Scholar
  6. 6.
    Breitenstein, M.D., Reichlin, F., Leibe, B., Koller-Meier, E., Van Gool, L.: Online multi-person tracking-by-detection from a single, uncalibrated camera. TPAMI 33(9), 1820–1833 (2010)CrossRefGoogle Scholar
  7. 7.
    Okuma, K., Taleghani, A., de Freitas, N., Little, J.J., Lowe, D.G.: A Boosted Particle Filter: Multitarget Detection and Tracking. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 28–39. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  8. 8.
    Qu, W., Schonfeld, D., Mohammed, M.: Distributed bayesian multiple-target tracking in crowded environments using multiple collaborative cameras. EURASIP Journal on Advances in Signal Processing (2007)Google Scholar
  9. 9.
    Zhou, Y., Benois-Pineau, J., Nicolas, H.: Multi-object particle filter tracking with automatic event analysis. In: ACM International Workshop on Analysis and Retrieval of Tracked Events and Motion in Imagery Streams (2010)Google Scholar
  10. 10.
    Willsky, A., Jones, H.: A generalized likelihood ratio approach to the detection and estimation of jumps in linear systems. IEEE Trans. on Automatic Control AC-21(1), 108–112 (1976)Google Scholar
  11. 11.
    Wang, F., Yu, S., Yang, J.: Robust and efficient fragments-based tracking using mean shift. Int. Journal of Electronics and Communications 64, 614–623 (2010)CrossRefGoogle Scholar
  12. 12.
    Di Caterina, G., Soraghan, J.: An improved mean shift tracker with fast failure recovery strategy after complete occlusion. In: 8th IEEE Int. Conf. on Advanced Video and Signal-Based Surveillance (2011)Google Scholar
  13. 13.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR, San Diego, CA, USA, vol. 1, pp. 886–893 (2005)Google Scholar
  14. 14.
    Pérez, P., Vermaak, J., Blake, A.: Data fusion for visual tracking with particles. Proceedings of the IEEE 92(3), 495–513 (2004)CrossRefGoogle Scholar
  15. 15.
    Neyman, J., Pearson, E.: On the problem of the most efficient tests of statistical hypotheses. Philosophical Transactions of the Royal Society of London, Series A, Containing Papers of a Mathematical or Physical Character 231, 289–337 (1933)CrossRefGoogle Scholar
  16. 16.
    Andriluka, M., Roth, S., Schiele, B.: People-tracking-by-detection and people-detection-by-tracking. In: Int. Conf. on Computer Vision and Pattern Recognition, Anchorage, AK, USA (2008)Google Scholar
  17. 17.
    Andriyenko, A., Roth, S., Schindler, K.: An analytical formulation of global occlusion reasoning for multi-target tracking. In: 11th IEEE International Workshop on Visual Surveillance (at ICCV), Barcelona (2011)Google Scholar
  18. 18.
    Bernardin, K., Stiefelhagen, R.: Evaluating multiple object tracking performance: the clear mot metrics. EURASIP Journal on Image and Video Processing (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • David Gerónimo Gomez
    • 1
  • Frédéric Lerasle
    • 2
    • 3
  • Antonio M. López Peña
    • 1
  1. 1.Computer Vision Center and Department of Computer ScienceUniversitat Autònoma de BarcelonaBellaterraSpain
  2. 2.CNRS-LAASToulouseFrance
  3. 3.Université de Toulouse (UPS)ToulouseFrance

Personalised recommendations