Object Tracking in Hyperspectral Videos with Convolutional Features and Kernelized Correlation Filter

  • Kun QianEmail author
  • Jun Zhou
  • Fengchao Xiong
  • Huixin Zhou
  • Juan Du
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11010)


Target tracking in hyperspectral videos is a new research topic. In this paper, a novel method based on convolutional network and Kernelized Correlation Filter (KCF) framework is presented for tracking objects of interest in hyperspectral videos. We extract a set of normalized three-dimensional cubes from the target region as fixed convolution filters which contain spectral information surrounding a target. The feature maps generated by convolutional operations are combined to form a three-dimensional representation of an object, thereby providing effective encoding of local spectral-spatial information. We show that a simple two-layer convolutional networks is sufficient to learn robust representations without the need of offline training with a large dataset. In the tracking step, KCF is adopted to distinguish targets from neighboring environment. Experimental results demonstrate that the proposed method performs well on sample hyperspectral videos, and outperforms several state-of-the-art methods tested on grayscale and color videos in the same scene.


Target tracking Hyperspectral video Correlation filter Convolutional networks 


  1. 1.
    Bai, X., Zhou, J., Kelly, A.: Pattern recognition for high performance. Pattern Recogn. 82, 38–39 (2018)CrossRefGoogle Scholar
  2. 2.
    Li, Y., Xie, W., Li, H.: Hyperspectral image reconstruction by deep convolutional neural network for classification. Pattern Recogn. 63, 371–383 (2017)CrossRefGoogle Scholar
  3. 3.
    Alam, F., Zhou, J., Alan, A., Jia, X., Chanussot, J., Gao, Y.: Conditional random field and deep feature learning for hyperspectral image segmentation. arXiv preprint arXiv:1711.04483 (2017)
  4. 4.
    Danelljan, M., Khan, F., Felsberg, M., Weijer, J.: Adaptive color attributes for real-time visual tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1090–1097 (2014)Google Scholar
  5. 5.
    Henriques, J.F., Caseiro, R., Martins, P., Batista, J.: Exploiting the circulant structure of tracking-by-detection with kernels. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7575, pp. 702–715. Springer, Heidelberg (2012). Scholar
  6. 6.
    Henriques, J., Caseiro, R., Martins, P., Batista, J.: High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell. 37(3), 583–596 (2015)CrossRefGoogle Scholar
  7. 7.
    Zhang, K., Liu, Q., Wu, Y., Yang, M.: Robust visual tracking via convolutional networks without training. IEEE Trans. Image Process. 25(4), 1779–1792 (2016)MathSciNetGoogle Scholar
  8. 8.
    Zhang, K., Zhang, L., Liu, Q., Zhang, D., Yang, M.-H.: Fast visual tracking via dense spatio-temporal context learning. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 127–141. Springer, Cham (2014). Scholar
  9. 9.
    Bolme, D., Beveridge, J., Draper, B., Lui, Y.: Visual object tracking using adaptive correlation filters. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2544–2550 (2010)Google Scholar
  10. 10.
    Li, Y., Zhu, J.: A scale adaptive kernel correlation filter tracker with feature integration. In: Agapito, L., Bronstein, M.M., Rother, C. (eds.) ECCV 2014. LNCS, vol. 8926, pp. 254–265. Springer, Cham (2015). Scholar
  11. 11.
    Nam, H., Han, B.: Learning multi-domain convolutional neural networks for visual tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 4293–4302 (2016)Google Scholar
  12. 12.
    Choi, J.W., et al.: Context-aware deep feature compression for high-speed visual tracking. In: IEEE Conference on Computer Vision and Pattern Recognition (2018)Google Scholar
  13. 13.
    Wang, L., Ouyang, W., Wang, X., Lu, H.: Visual tracking with fully convolutional networks. In: IEEE International Conference on Computer Vision, pp. 3119–3127 (2015)Google Scholar
  14. 14.
    Ma, C., Huang, J., Yang, X., Yang, M.: Hierarchical convolutional features for visual tracking. In: IEEE International Conference on Computer Vision, pp. 3074–3082 (2015)Google Scholar
  15. 15.
    Danelljan, M., Hager, G., Khan, F., Felsberg, M.: Convolutional features for correlation filter based visual tracking. In: IEEE International Conference on Computer Vision Workshops, pp. 58–66 (2015)Google Scholar
  16. 16.
    Wang, N., Yeung, D.: Learning a deep compact image representation for visual tracking. In: Advances in Neural Information Processing Systems, pp. 809–817 (2013)Google Scholar
  17. 17.
    Wu, Y., Lim, J., Yang, M.: Online object tracking: a benchmark. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2411–2418 (2013)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Kun Qian
    • 1
    Email author
  • Jun Zhou
    • 2
  • Fengchao Xiong
    • 3
  • Huixin Zhou
    • 1
  • Juan Du
    • 1
  1. 1.Lab of Optoelectronic Imaging and Image ProcessingXidian UniversityXi’anPeople’s Republic of China
  2. 2.School of Information and Communication TechnologyGriffith UniversityBrisbaneAustralia
  3. 3.College of Computer ScienceZhejiang UniversityHangzhouPeople’s Republic of China

Personalised recommendations