A Boosted Particle Filter: Multitarget Detection and Tracking

  • Kenji Okuma
  • Ali Taleghani
  • Nando de Freitas
  • James J. Little
  • David G. Lowe
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3021)


The problem of tracking a varying number of non-rigid objects has two major difficulties. First, the observation models and target distributions can be highly non-linear and non-Gaussian. Second, the presence of a large, varying number of objects creates complex interactions with overlap and ambiguities. To surmount these difficulties, we introduce a vision system that is capable of learning, detecting and tracking the objects of interest. The system is demonstrated in the context of tracking hockey players using video sequences. Our approach combines the strengths of two successful algorithms: mixture particle filters and Adaboost. The mixture particle filter [17] is ideally suited to multi-target tracking as it assigns a mixture component to each player. The crucial design issues in mixture particle filters are the choice of the proposal distribution and the treatment of objects leaving and entering the scene. Here, we construct the proposal distribution using a mixture model that incorporates information from the dynamic models of each player and the detection hypotheses generated by Adaboost. The learned Adaboost proposal distribution allows us to quickly detect players entering the scene, while the filtering process enables us to keep track of the individual players. The result of interleaving Adaboost with mixture particle filters is a simple, yet powerful and fully automatic multiple object tracking system.


Particle Filter Color Histogram Observation Model Proposal Distribution Mixture Representation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Comaniciu, D., Ramesh, V., Meer, P.: Real-Time Tracking of Non-Rigid Objects using Mean Shift. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 142–151 (2000)Google Scholar
  2. 2.
    Deutscher, J., Blake, A., Ried, I.: Articulated body motion capture by annealed particle filtering. In: IEEE Conference on Computer Vision and Pattern Recognition (2000)Google Scholar
  3. 3.
    Doucet, A., de Freitas, J.F.G.: Sequential Monte Carlo Methods in Practice. Springer, New York (2001)zbMATHGoogle Scholar
  4. 4.
    Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. In: Vitányi, P.M.B. (ed.) EuroCOLT 1995. LNCS, vol. 904, pp. 23–37. Springer, Heidelberg (1995)Google Scholar
  5. 5.
    Hue, C., Le Cadre, J.-P., Pérez, P.: Tracking Multiple Objects with Particle Filtering. IEEE Transactions on Aerospace and Electronic Systems 38(3), 791–812 (2002)CrossRefGoogle Scholar
  6. 6.
    Intille, S.S., Davis, J.W., Bobick, A.F.: Real-Time Closed-World Tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 697–703 (1997)Google Scholar
  7. 7.
    Isard, M., MacCormick, J.: BraMBLe: A Bayesian multiple-blob tracker. In: International Conference on Computer Vision, pp. 34–41 (2001)Google Scholar
  8. 8.
    Isard, M., Blake, A.: Condensation – conditional density propagation for visual tracking. International Journal on Computer Vision 28(1), 5–28 (1998)CrossRefGoogle Scholar
  9. 9.
    Kalman, R.E.: A New Approach to Linear Filtering and Prediction Problems. Transactions of the ASME–Journal of Basic Engineering 82(Series D), 35–45 (1960)Google Scholar
  10. 10.
    Koller, D., Weber, J., Malik, J.: Robust Multiple Car Tracking with Occlusion Reasoning. In: Eklundh, J.-O. (ed.) ECCV 1994. LNCS, vol. 800, pp. 186–196. Springer, Heidelberg (1994)Google Scholar
  11. 11.
    MacCormick, J., Blake, A.: A probabilistic exclusion principle for tracking multiple objects. In: International Conference on Computer Vision, pp. 572–578 (1999)Google Scholar
  12. 12.
    Misu, T., Naemura, M.: Robust Tracking of Soccer Players Based on Data Fusion. In: IEEE 16th International Conference on Pattern Recognition, vol. 1, pp. 556–561 (2002)Google Scholar
  13. 13.
    Needham, C.J., Boyle, R.D.: Tracking multiple sports players through occlusion, congestion and scale. In: British Machine Vision Conference, vol. 1, pp. 93–102. BMVA (2001)Google Scholar
  14. 14.
    Pérez, P., Hue, C., Vermaak, J., Gangnet, M.: Color-Based Probabilistic Tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 661–675. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  15. 15.
    Rui, Y., Chen, Y.: Better Proposal Distributions: Object Tracking Using Unscented Particle Filter. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 786–793 (2001)Google Scholar
  16. 16.
    van der Merwe, R., Doucet, A., de Freitas, J.F.G., Wan, E.: The Unscented Particle Filter. Advances in Neural Information Processing Systems 8, 351–357 (2000)Google Scholar
  17. 17.
    Vermaak, J., Doucet, A., Pérez, P.: Maintaining Multi-Modality through Mixture Tracking. In: International Conference on Computer Vision (2003)Google Scholar
  18. 18.
    Viola, P., Jones, M.: Rapid Object Detection using a Boosted Cascade of Simple Features. In: IEEE Conference on Computer Vision and Pattern Recognition (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Kenji Okuma
    • 1
  • Ali Taleghani
    • 1
  • Nando de Freitas
    • 1
  • James J. Little
    • 1
  • David G. Lowe
    • 1
  1. 1.University of British ColumbiaVancouverCANADA

Personalised recommendations