Effective Appearance Model and Similarity Measure for Particle Filtering and Visual Tracking

  • Hanzi Wang
  • David Suter
  • Konrad Schindler
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3953)


In this paper, we adaptively model the appearance of objects based on Mixture of Gaussians in a joint spatial-color space (the approach is called SMOG). We propose a new SMOG-based similarity measure. SMOG captures richer information than the general color histogram because it incorporates spatial layout in addition to color. This appearance model and the similarity measure are used in a framework of Bayesian probability for tracking natural objects. In the second part of the paper, we propose an Integral Gaussian Mixture (IGM) technique, as a fast way to extract the parameters of SMOG for target candidate. With IGM, the parameters of SMOG can be computed efficiently by using only simple arithmetic operations (addition, subtraction, division) and thus the computation is reduced to linear complexity. Experiments show that our method can successfully track objects despite changes in foreground appearance, clutter, occlusion, etc.; and that it outperforms several color-histogram based methods.


Similarity Measure Target Object Particle Filter Color Histogram Visual Tracking 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based Object Tracking. IEEE Trans. Pattern Analysis and Machine Intelligence 25(5), 564–577 (2003)CrossRefGoogle Scholar
  2. 2.
    Nummiaroa, K., Koller-Meierb, E., Gool, L.V.: An Adaptive Color-Based Particle Filter. Image and Vision Computing 21, 99–110 (2003)CrossRefGoogle Scholar
  3. 3.
    Isard, M., Blake, A.: Condensation-Conditional Density Propagation for Visual Tracking. International Journal of Computer Vision 29(1), 5–28 (1998)CrossRefGoogle Scholar
  4. 4.
    Perez, P., et al.: Color-Based Probabilistic Tracking. In: European Conference on Computer Vision, pp. 661–675 (2002)Google Scholar
  5. 5.
    Shen, C., Hengel, A.v.d., Dick, A.: Probabilistic Multiple Cue Integration for Particle Filter Based Tracking. In: International Conference on Digital Image Computing - Techniques and Applications, pp. 309–408 (2003)Google Scholar
  6. 6.
    McKenna, S.J., et al.: Tracking Groups of People. Computer Vision and Image Understanding 80, 42–56 (2000)zbMATHCrossRefGoogle Scholar
  7. 7.
    Pérez, P., Vermaak, J., Blake, A.: Data Fusion for Visual Tracking with Particles. Proceedings of the IEEE 92(3), 495–513 (2004)CrossRefGoogle Scholar
  8. 8.
    Yang, C., Duraiswami, R., Davis, L.: Fast Multiple Object Tracking via a Hierarchical Particle Filter. In: International Conference on Computer Vision, pp. 212–219 (2005)Google Scholar
  9. 9.
    Porikli, F.: Integral Histogram: A Fast Way to Extract Histograms in Cartesian Spaces. Computer Vision and Pattern Recognition, 829–836 (2005)Google Scholar
  10. 10.
    Zhou, S., Chellappa, R., Moghaddam, B.: Visual Tracking and Recognition Using Appearance-Adaptive Models in Particle Filters. IEEE Transactions on Image Processing 11, 1434–1456 (2004)Google Scholar
  11. 11.
    Lichtenauer, J., Reinders, M., Hendriks, E.: Influence of the Observation Likelihood Function on Particle Filtering Performance in Tracking Applications. In: IEEE International Conference on Automatic Face and Gesture Recognition, pp. 767–772 (2004)Google Scholar
  12. 12.
    Isard, M., Blake, A.: CONDENSATION: Unifying Low-level and High-level Tracking in a Stochastic Framework. In: European Conference on Computer Vision, pp. 893–908 (1998)Google Scholar
  13. 13.
    Wren, C.R., et al.: Pfinder: real-time tracking of the human body. IEEE Trans. Pattern Analysis and Machine Intelligence 19(7), 780–785 (1997)CrossRefGoogle Scholar
  14. 14.
    Elgammal, A., et al.: Background and Foreground Modeling using Non-parametric Kernel Density Estimation for Visual Surveillance. Proceedings of the IEEE 90(7), 1151–1163 (2002)CrossRefGoogle Scholar
  15. 15.
    Yang, C., Duraiswami, R., Davis, L.S.: Efficient Mean-Shift Tracking via a New Similarity Measure. Computer Vision and Pattern Recognition, 176–183 (2005)Google Scholar
  16. 16.
    McKenna, S.J., Raja, Y., Gong, S.: Tracking Colour Objects Using Adaptive Mixture Models. Image and Vision Computing 17, 225–231 (1999)CrossRefGoogle Scholar
  17. 17.
    Stauffer, C., Grimson, W.E.L.: Adaptive Background Mixture Models for Real-time Tracking. Computer Vision and Pattern Recognition, 246–252 (1999)Google Scholar
  18. 18.
    Han, B., Davis, L.: On-Line Density-Based Appearance Modeling for Object Tracking. In: International Conference on Computer Vision, pp. 1492–1499 (2005)Google Scholar
  19. 19.
    Wu, Y., Huang, T.S.: Robust Visual Tracking by Integrating Multiple Cues Based on Co-Inference Learning. International Journal of Computer Vision 58(1), 55–71 (2004)CrossRefGoogle Scholar
  20. 20.
    Khan, S., Shah, M.: Tracking People in Presence of Occlusion. In: Asian Conference on Computer Vision, pp. 263–266 (2000)Google Scholar
  21. 21.
    Birchfield, S., Rangarajan, S.: Spatiograms versus Histograms for Region-Based Tracking. Computer Vision and Pattern Recognition, 1152–1157 (2005)Google Scholar
  22. 22.
    Viola, P., Jones, M.: Robust Real-Time Face Detection. International Journal of Computer Vision 52(2), 137–154 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Hanzi Wang
    • 1
  • David Suter
    • 1
  • Konrad Schindler
    • 1
  1. 1.Institute for Vision Systems Engineering, Department of Electrical and Computer Systems EngineeringMonash UniversityClaytonAustralia

Personalised recommendations