Skip to main content
Log in

Temporal–spatial consistency of self-adaptive target response for long-term correlation filter tracking

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Owning to the impressive performance and high speed of the correlation filter (CF) visual tracking technology, the CF-based tracking gets a significant amount of attentions and obtains a large number of researches. But the traditional CF-based trackers have two inherent issues needed to be solved. On the one hand, the boundary effect caused by the circulant structure will affect the performance. On the other hand, the target response is assumed as Gaussian response and the value is fixed. In order to deal with the boundary effect, a spatially regularized method by imposing space penalties to the spatial coefficients is proposed. About the fixed target response, some researchers propose a framework that can adaptively change the response to deal with it, but the two issues only be coped with separately. We propose a tracker that utilizes the two merits jointly to win a better performance and a more robustness model which can cope with the complex environment to achieve a long-term tracking. We use an iteration solution to solve the joint cost function and ADMM algorithm to solve temporal–spatial consistency problem which can obtain a global solution and fast computation. We evaluate our method on the well-known visual tracking benchmark dataset called OTB50 and get a competitive performance result compared with the relevant trackers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Henriques, J.F., Caseiro, R., Martins, P., et al.: High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell. 37(3), 583–596 (2015)

    Article  Google Scholar 

  2. Danelljan, M., Hager, G., Shahbaz Khan, F., et al.: Learning spatially regularized correlation filters for visual tracking. In: Proceedings of the IEEE International Conference on Computer Vision 4310–4318 (2015)

  3. Danelljan, M., Robinson, A, Khan, F.S., et al.: Beyond correlation filters: Learning continuous convolution operators for visual tracking. In: European Conference on Computer Vision. Springer, Cham, 472–488 (2016)

  4. Danelljan, M., Bhat, G, Khan, F.S., et al.: ECO: efficient convolution operators for tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6638–6646 (2017)

  5. Li, F., Tian, C., Zuo, W., et al.: Learning spatial-temporal regularized correlation filters for visual tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4904–4913 (2018)

  6. Bibi, A., Mueller, M., Ghanem, B.: Target response adaptation for correlation filter tracking. In: European Conference on Computer Vision. Springer, Cham, pp. 419–433 (2016)

  7. Boyd, S., Parikh, N., Chu, E., et al.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends® Mach. Learn. 3(1), 1–122 (2011)

    MATH  Google Scholar 

  8. Hester, C.F., Casasent, D.: Multivariant technique for multiclass pattern recognition. Appl. Opt. 19(11), 1758–1761 (1980)

    Article  Google Scholar 

  9. Henriques, J.F., Carreira, J., Caseiro, R., et al.: Beyond hard negative mining: efficient detector learning via block-circulant decomposition. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2760–2767

  10. Naresh Boddeti, V, Kanade, T, Vijaya Kumar, B.V.K.: Correlation filters for object alignment. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2291–2298 (2013)

  11. Bolme, D.S., Beveridge, J.R., Draper, B.A., et al.: Visual object tracking using adaptive correlation filters. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE, pp. 2544–2550 (2010)

  12. Henriques, J.F., Caseiro, R., Martins, P., et al.: Exploiting the circulant structure of tracking-by-detection with kernels. In: European Conference on Computer Vision. Springer, Berlin, pp. 702–715 (2012)

  13. Kiani Galoogahi, H., Sim, T., Lucey, S.: Correlation filters with limited boundaries. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4630–4638 (2015)

  14. Petersen, K.B., Pedersen, M.S.: The matrix cookbook. Tech. Univ. Denmark 7(15), 510 (2008)

    Google Scholar 

  15. Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark. In: CVPR, 2013 IEEE Conference on. IEEE, pp. 2411–2418 (2013)

  16. Wang, L., Ouyang, W., Wang, X., et al.: Visual tracking with fully convolutional networks. In: Proceedings of the IEEE International Conference On Computer Vision, pp. 3119–3127 (2015)

  17. Bertinetto, L., Valmadre, J., Henriques, J.F., et al.: Fully-convolutional siamese networks for object tracking. In: European Conference on Computer Vision. Springer, Cham, pp. 850–865

  18. Zhang, J., Ma, S., Sclaroff, S.: MEEM: robust tracking via multiple experts using entropy minimization. In: European Conference on Computer Vision. Springer, Cham, pp. 188–203 (2014)

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (No. 61175033).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhongpei Wang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, H., Wang, Z., Fang, B. et al. Temporal–spatial consistency of self-adaptive target response for long-term correlation filter tracking. SIViP 14, 639–644 (2020). https://doi.org/10.1007/s11760-019-01594-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-019-01594-2

Keywords

Navigation