Skip to main content
SpringerLink
Log in

Particle filter re-detection for visual tracking via correlation filters

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Most of the correlation filter based tracking algorithms can achieve good performance and maintain fast computational speed. However, in some complicated tracking scenes, there is a fatal defect that causes the object to be located inaccurately, which is the trackers excessively dependent on the maximum response value to determine the object location. In order to address this problem, we propose a particle filter redetection based tracking approach for accurate object localization. During the tracking process, the kernelized correlation filter (KCF) based tracker can locate the object by relying on the maximum response value of the response map; when the response map becomes ambiguous, the tracking result becomes unreliable correspondingly. Our redetection model can provide abundant object candidates by particle resampling strategy to detect the object accordingly. Additionally, for the target scale variation problem, we give a new object scale evaluation mechanism, which merely considers the differences between the maximum response values in consecutive frames to determine the scale change of the object target. Extensive experiments on OTB2013 and OTB2015 datasets demonstrate that the proposed tracker performs favorably in relation to the state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Bolme DS, Beveridge JR, Draper BA, Lui YM (2010) Visual object tracking using adaptive correlation filters. In: Computer vision and pattern recognition, pp 2544–2550

  2. Cehovin L, Kristan M, Leonardis A (2014) Is my new tracker really better than yours. In: Applications of computer vision, pp 540–547

  3. Chen WS, Yuen P, Huang J, Fang B (2008) Two-step single parameter regularization fisher discriminant method for face recognition. Int J Pattern Recognit Artif Intell 20(02):189–207

    Article  Google Scholar 

  4. Chen Z, You X, Zhong B, Li J, Tao D (2016) Dynamically modulated mask sparse tracking. IEEE Transactions on Cybernetics 47(11):3706–3718

    Article  Google Scholar 

  5. Danelljan M, Häger G, Khan FS, Felsberg M (2014) Accurate scale estimation for robust visual tracking. In: British machine vision conference, pp 1–11

  6. Danelljan M, Khan FS, Felsberg M, Weijer JVD (2014) Adaptive color attributes for real-time visual tracking. In: Computer vision and pattern recognition, pp 1090–1097

  7. Danelljan M, Hager G, Khan FS, Felsberg M (2015) Learning spatially regularized correlation filters for visual tracking. In: IEEE international conference on computer vision, pp 4310–4318

  8. Danelljan M, Hager G, Khan FS, Felsberg M (2017) Discriminative scale space tracking. IEEE Trans Pattern Anal Mach Intell 39(8):1561–1575

    Article  Google Scholar 

  9. Everingham M, Winn J (2011) The pascal visual object classes challenge 2010 (voc2010) development kit contents. In: International conference on machine learning, pp 117–176

  10. Fazli S, Pour HM, Bouzari H (2009) Particle filter based object tracking with sift and color feature. In: Second international conference on machine vision, pp 89–93

  11. Galoogahi HK, Fagg A, Lucey S (2017) Learning background-aware correlation filters for visual tracking, pp 1144–1152

  12. Gao J, Ling H, Hu W, Xing J (2014) Transfer learning based visual tracking with gaussian processes regression. In: European conference on computer vision, pp 188–203

  13. Guo Z, Wang X, Zhou J, You J (2015) Robust texture image representation by scale selective local binary patterns. IEEE Trans Image Process 25(2):687–699

    Article  MathSciNet  MATH  Google Scholar 

  14. Hare S, Saffari A, Torr PHS (2012) Struck: structured output tracking with kernels. In: International conference on computer vision, pp 263–270

  15. He Z, Chung AC (2010) 3-D b-spline wavelet-based local standard deviation (bwlsd): Its application to edge detection and vascular segmentation in magnetic resonance angiography. Int J Comput Vis 87(3):235–265

    Article  Google Scholar 

  16. He Z, You X, Tang Y (2008) Writer identification using global wavelet-based features. Neurocomputing 71(10-12):1832–1841

    Article  Google Scholar 

  17. He Z, You X, Yuan Y (2009) Texture image retrieval based on non-tensor product wavelet filter banks. Signal Process 89(8):1501–1510

    Article  MATH  Google Scholar 

  18. He Z, You X, Zhou L, Cheung Y, Du J (2010) Writer identification using fractal dimension of wavelet subbands in gabor domain. Integrated Computer Aided Engineering 17(17):157–165

    Article  Google Scholar 

  19. He Z, Cui Y, Wang H, You X, Chen CLP (2015) One global optimization method in network flow model for multiple object tracking. Knowl-Based Syst 86:21–32

    Article  Google Scholar 

  20. He Z, Li X, You X, Tao D, Tang Y (2016) Connected component model for multi-object tracking. IEEE Trans Image Process 25(8):3698–3711

    Article  MathSciNet  MATH  Google Scholar 

  21. He Z, Yi S, Cheung YM, You X (2016) Robust object tracking via key patch sparse representation. IEEE Transactions on Cybernetics 47(2):354–364

    Google Scholar 

  22. Henriques JF, Rui C, Martins P, Batista J (2012) Exploiting the circulant structure of tracking-by-detection with kernels. In: European Conference on Computer Vision, pp 702–715

  23. Henriques JF, Caseiro R, Martins P, Batista J (2014) High-speed tracking with kernelized correlation filters. IEEE Trans Pattern Anal Mach Intell 37(3):583–596

    Article  Google Scholar 

  24. Hong S, You T, Kwak S, Han B (2015) Online tracking by learning discriminative saliency map with convolutional neural network. In: International conference on machine learning, pp 597–606

  25. Hossain K, Lee CW (2013) Visual object tracking using particle filter. In: International conference on ubiquitous robots and ambient intelligence, pp 98–102

  26. Isard M, Blake A (1998) Condensation-conditional density propagation forvisual tracking. Kluwer, Boston, pp 5–28

    Google Scholar 

  27. Jing XY, Zhu X, Wu F, You X, Liu Q, Yue D, Hu R, Xu B (2015) Super-resolution person re-identification with semi-coupled low-rank discriminant dictionary learning. In: Computer vision and pattern recognition, pp 695–704

  28. Jing XY, Wu F, Zhu X, Dong X, Ma F, Li Z (2016) Multi-spectral low-rank structured dictionary learning for face recognition. Pattern Recogn 59:14–25

    Article  Google Scholar 

  29. Lai Z, Xu Y, Chen Q, Yang J, Zhang D (2014) Multilinear sparse principal component analysis. IEEE Transactions on Neural Networks and Learning Systems 25 (10):1942–1950

    Article  Google Scholar 

  30. Lai Z, Wong WK, Xu Y, Yang J, Zhang D (2016) Approximate orthogonal sparse embedding for dimensionality reduction. IEEE Transactions on Neural Networks and Learning Systems 27(4):723–735

    Article  MathSciNet  Google Scholar 

  31. Li Y, Zhu J (2014) A scale adaptive kernel correlation filter tracker with feature integration. In: European conference on computer vision, pp 254–265

  32. Li X, He Z, You X, Chen CLP (2014) A novel joint tracker based on occlusion detection. Knowl-Based Syst 71:409–418

    Article  Google Scholar 

  33. Li Y, Zhu J, Hoi SCH (2015) Reliable patch trackers: Robust visual tracking by exploiting reliable patches. In: Computer vision and pattern recognition, pp 353–361

  34. Li X, Liu Q, He Z, Wang H, Zhang C, Chen WS (2016) A multi-view model for visual tracking via correlation filters. Knowl-Based Syst 113:88–99

    Article  Google Scholar 

  35. Li X, Lan S, Jiang Y, Xu P (2017) Visual tracking based on adaptive background modeling and improved particle filter. In: IEEE international conference on computer and communications, pp 469–473

  36. Liu T, Wang G, Yang Q (2015) Real-time part-based visual tracking via adaptive correlation filters. In: Computer vision and pattern recognition, pp 4902–4912

  37. Liu S, Zhang T, Cao X, Xu C (2016) Structural correlation filter for robust visual tracking. In: Computer vision and pattern recognition, pp 4312–4320

  38. Liu Q, Lu X, He Z, Zhang C, Chen WS (2017) Deep convolutional neural networks for thermal infrared object tracking. Knowl-Based Syst 134:189–198

    Article  Google Scholar 

  39. Ma X, Liu Q, He Z, Zhang X, Chen WS (2016) Visual tracking via exemplar regression model. Knowl-Based Syst 106:26–37

    Article  Google Scholar 

  40. Mai TNT, Kim S (2016) Optimization for particle filter-based object tracking in embedded systems using parallel programming. In: International conference on computer science and its applications, pp 246–252

  41. Mozhdehi RJ, Medeiros H (2017) Deep convolutional particle filter for visual tracking. In: IEEE international conference on image processing, pp 3650–3654

  42. Ou W, You X, Tao D, Zhang P, Tang Y, Zhu Z (2014) Robust face recognition via occlusion dictionary learning. Pattern Recogn 47(4):1559–1572

    Article  Google Scholar 

  43. Ou W, Li G, Zhang K, Xie G (2016) Multi-view non-negative matrix factorization by patch alignment framework with view consistency. Neurocomputing 204(C):116–124

    Article  Google Scholar 

  44. Ou W, Yuan D, Li D, Liu B, Xia D, Zeng W (2017) Patch-based visual tracking with online representative sample selection. J Electron Imaging 26 (3):033006(1)–033006(12)

    Article  Google Scholar 

  45. Ou W, Yuan D, Liu Q, Cao Y (2018) Object tracking based on online representative sample selection via non-negative least square. Multimedia Tools and Applications 77(9):10569–10587

    Article  Google Scholar 

  46. Qi Y, Zhang S, Qin L, Yao H, Huang Q, Lim J, Yang MH (2016) Hedged deep tracking. In: Computer vision and pattern recognition, pp 4303–4311

  47. Qi G, Jing XY, Wu F, Wei Z, Liang X, Shao W, Dong Y, Li H (2017) Structure-based low-rank model with graph nuclear norm regularization for noise removal. IEEE Trans Image Process 26(7):3098–3112

    Article  MathSciNet  MATH  Google Scholar 

  48. Qian J, Fang B, Yang W, Luan X, Nan H (2011) Accurate tilt sensing with linear model. IEEE Sensors J 11(10):2301–2309

    Google Scholar 

  49. Shi X, Guo Z, Nie F, Yang L, Tao D (2016) Two-dimensional whitening reconstruction for enhancing robustness of principal component analysis. IEEE Trans Pattern Anal Mach Intell 38(10):2130–2136

    Article  Google Scholar 

  50. Valmadre J, Bertinetto L, Henriques JF, Vedaldi A, Torr PHS (2017) End-to-end representation learning for correlation filter based tracking. In: Computer vision and pattern recognition, pp 2805–2813

  51. Van Trees H, Bell K (2007) A tutorial on particle filters for online nonlinear/nongaussian Bayesian tracking. Wiley, New York, pp 723–737

    Google Scholar 

  52. Wu Y, Lim J, Yang MH (2013) Online object tracking: a benchmark. In: IEEE conference on computer vision and pattern recognition, pp 2411–2418

  53. Wu Y, Lim J, Yang MH (2015) Object tracking benchmark. IEEE Trans Pattern Anal Mach Intell 37(9):1834–1848

    Article  Google Scholar 

  54. Wu F, Jing XY, You X, Yue D, Hu R, Yang JY (2016) Multi-view low-rank dictionary learning for image classification. Pattern Recogn 50:143–154

    Article  MATH  Google Scholar 

  55. Yang MH, Lu H, Zhong W (2012) Robust object tracking via sparsity-based collaborative model. In: Computer vision and pattern recognition, pp 1838–1845

  56. Yi S, He Z, You X, Cheung YM (2015) Single object tracking via robust combination of particle filter and sparse representation. Signal Process 110:178–187

    Article  Google Scholar 

  57. Yi S, He Z, Cheung YM, Chen WS (2017) Unified sparse subspace learning via self-contained regression. IEEE Trans Circuits Syst Video Technol PP(99):1–14

    Google Scholar 

  58. Yi S, Lai Z, He Z, Cheung Y-M, Liu Y (2017) Joint sparse principal component analysis. Pattern Recogn 61:524–536

    Article  Google Scholar 

  59. You X, Li X, He Z, Zhang X (2014) A robust local sparse tracker with global consistency constraint. Signal Process 111:308–318

    Article  Google Scholar 

  60. Yu Y, Che Y (2010) Infrared object tracking based on particle filter. In: International congress on image and signal processing, pp 1508–1511

  61. Zhang K, Zhang L, Liu Q, Zhang D, Yang MH (2014) Fast visual tracking via dense spatio-temporal context learning. In: European Conference on computer vision, pp 127–141

  62. Zhang S, Zhou H, Jiang F, Li X (2015) Robust visual tracking using structurally random projection and weighted least squares. IEEE Trans Circuits Syst Video Technol 25(11):1749–1760

    Article  Google Scholar 

  63. Zhang T, Bibi A, Ghanem B (2016) In defense of sparse tracking: Circulant sparse tracker. In: Computer vision and patter recognition, pp 3880–3888

  64. Zhang K, Liu Q, Wu Y, Yang MH (2016) Robust visual tracking via convolutional networks without training. IEEE Trans Image Process 25(4):1779–1792

    MathSciNet  MATH  Google Scholar 

  65. Zhang S, Lan X, Qi Y, Yuen P (2017) Robust visual tracking via basis matching. IEEE Trans Circuits Syst Video Technol 27(3):421–430

    Article  Google Scholar 

  66. Zhang T, Xu C, Yang MH (2017) Multi-task correlation particle filter for robust object tracking. In: IEEE conference on computer vision and pattern recognition, pp 4819–4827

  67. Zhao Y, You X, Yu S, Xu C, Yuan W, Jing XY, Zhang T, Tao D (2018) Multi-view manifold learning with locality alignment. Pattern Recogn 78:154–166

    Article  Google Scholar 

  68. Zhou SK, Chellappa R, Moghaddam B (2004) Visual tracking and recognition using appearance-adaptive models in particle filters. IEEE Trans Image Process 13 (11):1491–1506

    Article  Google Scholar 

  69. Zhou H, Gao Y, Yuan G, Ji R (2016) Adaptive multiple cues integration for particle filter tracking. In: IET international radar conference, pp 31–36

Download references

Acknowledgment

This study was supported by by the National Natural Science Foundation of China (Grant No. 61672183), the Shenzhen Research Council (Grant No.JCYJ20170413104556946, JCYJ20170815113552036, JCYJ20160226201453085), by Science and Technology Planning Project of Guanddong Province (Grant No. 2016B090918047), and by Shenzhen Medical Biometrics Perception and Analysis Engineering Laboratory.

Author information

Author notes

    Authors and Affiliations

    1. School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen), Shenzhen, China

      Di Yuan, Xiaohuan Lu, Donghao Li & Yingyi Liang

    2. School of Science, Harbin Institute of Technology (Shenzhen), Shenzhen, China

      Xinming Zhang

    Authors
    1. Di Yuan
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Xiaohuan Lu
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Donghao Li
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Yingyi Liang
      View author publications

      You can also search for this author in PubMed Google Scholar

    5. Xinming Zhang
      View author publications

      You can also search for this author in PubMed Google Scholar

    Corresponding authors

    Correspondence to Di Yuan, Yingyi Liang or Xinming Zhang.

    Additional information

    Publisher’s Note

    Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

    D. Yuan and X. Lu are contributed equally to this work and should be considered co-first authors.

    Rights and permissions

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Yuan, D., Lu, X., Li, D. et al. Particle filter re-detection for visual tracking via correlation filters. Multimed Tools Appl 78, 14277–14301 (2019). https://doi.org/10.1007/s11042-018-6800-0

    Download citation

    • Received:

    • Revised:

    • Accepted:

    • Published:

    • Issue Date:

    • DOI: https://doi.org/10.1007/s11042-018-6800-0

    Keywords

    Search

    Navigation