Correlation Filter Tracking Algorithm Based on Spatio-Temporal Context

  • Jin DieEmail author
  • Na Li
  • Ying Liu
  • Yangyang Wu
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1074)


Object tracking has been widely used in artificial intelligence, military reconnaissance, security monitoring and other fields. It has become a research hotspot of computer vision. To handle the drift problem in the presence of occlusions, a tracker combined with spatio-temporal context information and correlation filter is proposed in this paper. HOG (Histogram of Oriented Gradient), CN (Color Name) and gray features are extracted to learn the correlation filter. Meanwhile, the spatio-temporal context model is trained. The response map of correlation filter and spatio-temporal context model are normalized and fused. Experimental results show that the proposed algorithm can accurately track the object, and has better performance in terms of successful rate, center position error and distance precision.


Object tracking Spatio-temporal context Correlation filter 



This work is supported by the graduate innovation fund project of Xi’an university of posts and telecommunications. (Grant No. CXJJLY2018027). Shaanxi Science and Technology Innovation and Entrepreneurship Dual Tutor System Project (2019JM-604), National Science Foundation of China (61601362, 61571361).


  1. 1.
    Yilmaz, A., Javad, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. (CSUR) 38(4), 1–45 (2006)CrossRefGoogle Scholar
  2. 2.
    Kim, D.Y., Jeon, M.: Spatial-temporal auxiliary particle filtering with l1-norm based appearance model learning for robust visual tracking. IEEE Trans. Image Process. 22(2), 511–522 (2013)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Zhang, K.H., Zhang, L., Liu, Q.S., et al.: Fast visual tracking via dense spatio-temporal context learning. In: ECCV, Zurich, pp, 127–141. Springer, Switzerland (2014)Google Scholar
  4. 4.
    Mueller, M., Smith, N., Ghanem, B.: Context-aware correlation filter tracking. In: CVPR, King Abdullah University of Science and Technology, pp, 1396–1404 (2017)Google Scholar
  5. 5.
    Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking learning-detection. IEEE Trans. Pattern Anal. Mach. Intell. 34(7), 1409–1422 (2011)CrossRefGoogle Scholar
  6. 6.
    Dinh, T.B., Vo, N., Medioni, G.: Context tracker: exploring supporters and distracters in unconstrained environments. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR, pp, 1177–1184 (2011)Google Scholar
  7. 7.
    Xu, J.Q., Lu, Y., Liu, J.W.: Robust tracking via weighted spatio-temporal context learning. In: Proceedings of the IEEE International Conference on Image Processing, pp. 413–416 (2014)Google Scholar
  8. 8.
    Liu, W.J., Dong, S.H., Qu, H.C.: Anti-occlusion visual tracking algorithm based on spatio-temporal context learning. J. Image Graph. 21(8), 1057–1067 (2016)Google Scholar
  9. 9.
    Yu, L.Y., Fan, C.X., Ming, Y.: Improved object tracking algorithm based on kernelized correlation filter. J. Comput. Appl. 35(12), 3550–3554 (2015)Google Scholar
  10. 10.
    Qian, T.H., Luo, Z.Q., Li, G.J., et al.: Scale adaptive improvement of kernel correlation filter tracking algorithm. J. Comput. Appl. 37(3), 811–816 (2017)Google Scholar
  11. 11.
    Lu, J.H., Chen, Y.M., Zou, Y.B., Zou, G.Z.: Long-term tracking based on spatio-temporal context. J. Shanghai Jiao Tong Univ. 22(4), 504–512 (2017)CrossRefGoogle Scholar
  12. 12.
    David, S.B.J., Ross, B., Bruce, A.: Visual object tracking using adaptive correlation filters. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2544–2550 (2010)Google Scholar
  13. 13.
    Joao, F.H., Rui, C., Pedro, M., Jorge, B.: Exploiting the circulant structure of tracking-by-detection with kernels. In: ECCV, pp. 702–715 (2012)Google Scholar
  14. 14.
    Henriques, J.F., Caseiro, R., Martins, P.: High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell. 37(3), 583–596 (2015)CrossRefGoogle Scholar
  15. 15.
    Li, Y., Zhu, J.: A scale adaptive kernel correlation filter tracker with feature integration. In: ECCV, pp. 254–265 (2014)Google Scholar
  16. 16.
    Danelljan, M., Hager, G., Khan, F.S., Felsberg, M.: Accurate scale estimation for robust visual tracking. In: BMVC (2014)Google Scholar
  17. 17.
    Danelljan, M., Hager, G., Khan, F.S., Felsberg, M.: Discriminative scale space tracking. IEEE Trans. Pattern Anal. Mach. Intell. 39(8), 1561–1575 (2017)CrossRefGoogle Scholar
  18. 18.
    Danelljan, M., Hager, G., Khan, F.S., Felsberg, M.: Learning spatially regularized correlation filters for visual tracking. In: ICCV, pp. 4310–4318 (2015)Google Scholar
  19. 19.
    Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark, pp. 2411–2418. IEEE Computer Society, United States (2013)Google Scholar
  20. 20.
    Zheng, Y., Chen, Q.Q., Zhang, Y.J.: Deep learning and its new progress in object and behavior recognition. J. Image Graph. 19(2), 175–184 (2014)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.School of Communication and Information EngineeringXi’an University of Posts and TelecommunicationsXi’anChina
  2. 2.Key Laboratory of Electronic Information Application Technology for Scene InvestigationMinistry of Public SecurityXi’anChina
  3. 3.International Joint Research Center for Wireless Communication and Information Processing TechnologyXi’anChina

Personalised recommendations