Robust Auxiliary Particle Filter with an Adaptive Appearance Model for Visual Tracking

  • Du Yong Kim
  • Ehwa Yang
  • Moongu Jeon
  • Vladimir Shin
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6494)


The algorithm proposed in this paper is designed to solve two challenging issues in visual tracking: uncertainty in a dynamic motion model and severe object appearance change. To avoid filter drift due to inaccuracies in a dynamic motion model, a sliding window approach is applied to particle filtering by considering a recent set of observations with which internal auxiliary estimates are sequentially calculated, so that the level of uncertainty in the motion model is significantly reduced. With a new auxiliary particle filter, abrupt movements can be effectively handled with a light computational load. Another challenge, severe object appearance change, is adaptively overcome via a modified principal component analysis. By utilizing a recent set of observations, the spatiotemporal piecewise linear subspace of an appearance manifold is incrementally approximated. In addition, distraction in the filtering results is alleviated by using a layered sampling strategy to efficiently determine the best fit particle in the high-dimensional state space. Compared to existing algorithms, the proposed algorithm produces successful results, especially when difficulties are combined.


Visual Tracking Slide Window Approach Auxiliary Particle Abrupt Motion Observation Likelihood 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kwon, J., Park, F.C.: Visual tracking via particle filtering on the affine group. IJRR (2009)Google Scholar
  2. 2.
    Kwon, J., Lee, K.M., Park, F.C.: Visual tracking via geometric particle filtering on the affine group with optimal importance functions. In: CVPR (2009)Google Scholar
  3. 3.
    Barbenko, B., Yang, M.H., Belongie, S.: Visual tracking with online multiple instance learning. In: CVPR (2009)Google Scholar
  4. 4.
    Li, Y., Ai, H., Yamashida, T., Lao, S., Kawade, M.: Tracking in low fame rate video: A cascade particle filter with discriminative observers of different life spans. IEEE PAMI, 1728–1740 (2008)Google Scholar
  5. 5.
    Matthews, I., Ishikawa, T., Baker, S.: The template update problem. IEEE PAMI, 810–815 (2004)Google Scholar
  6. 6.
    Yang, M., Fan, Z., Wu, Y.: Tracking nonstationary visual appearances by data-driven adaptation. IEEE TIP, 1633–1644 (2009)Google Scholar
  7. 7.
    Han, B.H., Zhu, Y., Comaniciu, D., Davis, S.L.: Kernel-based bayesian filtering for object tracking. In: CVPR (2005)Google Scholar
  8. 8.
    Ross, R.D., Lim, J., Lin, R.S., Yang, M.H.: Incremental learning for robust visual tracking. IJCV (2008)Google Scholar
  9. 9.
    Jepson, A.D., Fleet, J., Maraghi, T.F.: Robust online appearance models for visual tracking. IEEE PAMI (2001)Google Scholar
  10. 10.
    Jazwinski, A.: Stochastic process and filtering theory. Academic Press, London (1970)zbMATHGoogle Scholar
  11. 11.
    Kwon, W.H., Kim, P.S., Park, P.G.: A receding horizon kalman fir filter for linear continuous-time systems. IEEE TAC (1999)Google Scholar
  12. 12.
    Lee, K.C., Ho, J., Yang, M.H., Kriegman, D.: Video-based face recognition using probabilistic appearance manifolds. In: CVPR (2003)Google Scholar
  13. 13.
    Lim, H., Morariu, V., Camps, O.I., Sznaier, M.: Dynamic appearance modeling for human tracking. In: CVPR (2006)Google Scholar
  14. 14.
    Blake, A., Isard, M.: Active contours. Springer, Heidelberg (1998)CrossRefGoogle Scholar
  15. 15.
    Isard, M., Blake, A.: Contour tracking by stochastic propagation of conditional density. In: Buxton, B.F., Cipolla, R. (eds.) ECCV 1996. LNCS, vol. 1065. Springer, Heidelberg (1996)Google Scholar
  16. 16.
    Rui, Y., Chen, Y.: Online learning of probabilistic appearance manifolds for video-based recognition and tracking. In: CVPR (2001)Google Scholar
  17. 17.
    Doucet, A., Goodsil, S., Andrieu, C.: On sequential monte carlo sampling methods for bayesian filtering. Statistics and Computing, 197–208 (2000)Google Scholar
  18. 18.
    Pitt, M., Shephard, N.: Filtering via simulation: auxiliary particle filters. Journal of American Statistical Association, 590–599 (1999)Google Scholar
  19. 19.
    Vlassis, N., Terwijin, B., Kros, B.: Auxiliary particle filter robot localization from high-dimensional sensor observations. In: ICRA (2002)Google Scholar
  20. 20.
    Deutsher, J., Blake, A., Reid, I.: Articulated body motion capture by annealed particle filter. In: CVPR (2000)Google Scholar
  21. 21.
    Shen, C., Kim, J., Wang, H.: Generalized kernel-based visual tracking. IEEE CSVT, 119–130 (2010)Google Scholar
  22. 22.
    Levy, A., Lindenbaum, M.: Sequential karhunen-loeve basis extraction and its application to images. IEEE TIP, 1371–1374 (2000)Google Scholar
  23. 23.
    Lee, K.C., Kriegman, D.: Online learning of probabilistic appearance manifolds for video-based recognition and tracking. In: CVPR (2005)Google Scholar
  24. 24.
    Kim, M., Kumar, S., Pavlovic, V., Rowley, H.: Face tracking and recognition with visual constraints in real-world videos. In: CVPR (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Du Yong Kim
    • 1
  • Ehwa Yang
    • 1
  • Moongu Jeon
    • 1
  • Vladimir Shin
    • 1
  1. 1.School of Information and MechatronicsGwangju Institute of Science and TechnologyKorea

Personalised recommendations