Visual Tracking by Local Superpixel Matching with Markov Random Field

  • Heng Fan
  • Jinhai XiangEmail author
  • Zhongmin Chen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9916)


In this paper, we propose a novel method to track non-rigid and/or articulated objects using superpixel matching and markov random field (MRF). Our algorithm consists of three stages. First, a superpixel dataset is constructed by segmenting training frames into superpixels, and each superpixel is represented by multiple features. The appearance information of target is encoded in the superpixel database. Second, each new frame is segmented into superpixels and then its object-background confidence map is derived by comparing its superpixels with k-nearest neighbors in superpixel dataset. Taking context information into account, we utilize MRF to further improve the accuracy of confidence map. In addition, the local context information is incorporated through a feedback to refine superpixel matching. In the last stage, visual tracking is achieved via finding the best candidate by maximum a posterior estimate based on the confidence map. Experiments show that our method outperforms several state-of-the-art trackers.


Visual tracking Superpixel matching Markov Random Field (MRF) Local context information 



This work was primarily supported by Foundation Research Funds for the Central Universities (Program No. 2662016PY008 and Program No. 2662014PY052).


  1. 1.
    Adam, A., Rivlin, E., Shimshoni, I.: Robust fragments based tracking using the integral histogram. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 798–805 (2006)Google Scholar
  2. 2.
    Avidan, S.: Ensemble tracking. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 29(2), 261–271 (2007)CrossRefGoogle Scholar
  3. 3.
    Babenko, B., Yang, M.-H., Belongie, S.: Robust object tracking with online multiple instance learning. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 33(8), 1619–1632 (2011)CrossRefGoogle Scholar
  4. 4.
    Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 23(11), 1222–1239 (2001)CrossRefGoogle Scholar
  5. 5.
    Fan, H., Xiang, J.: Robust visual tracking with multitask joint dictionary learning. IEEE Trans. Circ. Syst. Video Technol. PP, 1 (2016)Google Scholar
  6. 6.
    Fan, H., Xiang, J., Zhao, L.: Robust visual tracking via bag of superpixels. Multimedia Tools Appl. 75, 8781 (2015)CrossRefGoogle Scholar
  7. 7.
    Fan, H., Xiang, J., Liao, H., Du, X.: Robust tracking based on local structural cell graph. J. Vis. Commun. Image Represent. 31, 54–63 (2015)CrossRefGoogle Scholar
  8. 8.
    Fan, H., Xiang, J., Ni, F.: Multilayer feature combination for visual tracking. In: Asian Conference on Pattern Recognition (ACPR), pp. 589–593 (2015)Google Scholar
  9. 9.
    Fan, H., Xiang, J.: Patch-based visual tracking with two-stage multiple Kernel learning. In: Zhang, Y.-J. (ed.) ICIG 2015. LNCS, vol. 9219, pp. 20–33. Springer, Heidelberg (2015). doi: 10.1007/978-3-319-21969-1_3 CrossRefGoogle Scholar
  10. 10.
    Fan, H., Xiang, J., Xu, J., Liao, H.: Part-based visual tracking via online weighted P-N learning. Sci. World J. (2014)Google Scholar
  11. 11.
    Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph based image segmentation. Int. J. Comput. Vis. (IJCV) 59(2), 167–181 (2004)CrossRefGoogle Scholar
  12. 12.
    Jia, X., Lu, H., Yang, M.-H.: Visual tracking via adaptive structural local sparse appearance model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1822–1829 (2012)Google Scholar
  13. 13.
    Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking-learning-detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 34(7), 1409–1422 (2012)CrossRefGoogle Scholar
  14. 14.
    Liang, P., Blasch, E., Ling, H.: Encoding color information for visual tracking: algorithms and benchmark. IEEE Trans. Image Process. (TIP) 24(12), 5630–5644 (2015)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Mei, X., Ling, H.: Robust visual tracking and vehicle classification via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 33(11), 2259–2272 (2011)CrossRefGoogle Scholar
  16. 16.
    Ross, D.A., Lim, J., Lin, R.S., Yang, M.-H.: Incremental learning for robust visual tracking. Int. J. Comput. Vis. (IJCV) 77(1), 125–141 (2008)CrossRefGoogle Scholar
  17. 17.
    Wang, D., Lu, H.: Visual tracking via probability continuous outlier model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3478–3485 (2014)Google Scholar
  18. 18.
    Yang, F., Lu, H., Yang, M.-H.: Robust superpixel tracking. IEEE Trans. Image Process. (TIP) 23(4), 1639–1651 (2014)MathSciNetCrossRefGoogle Scholar
  19. 19.
    Yang, J., Price, B., Cohen, S., Yang, M.-H.: Context driven scene parsing with attention to rare classes. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3294–3301 (2014)Google Scholar
  20. 20.
    Zhang, K., Zhang, L., Yang, M.-H.: Fast compressive tracking. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36(10), 2002–2015 (2014)CrossRefGoogle Scholar
  21. 21.
    Zhang, K., Zhang, L., Liu, Q., Zhang, D., Yang, M.-H.: Fast visual tracking via dense spatio-temporal context learning. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 127–141. Springer, Heidelberg (2014). doi: 10.1007/978-3-319-10602-1_9 Google Scholar
  22. 22.
    Zhang, T., Ghanem, B., Liu, S., Ahuja, N.: Robust visual tracking via structured multi-task sparse learning. Int. J. Comput. Vis. (IJCV) 101, 367–383 (2013)MathSciNetCrossRefGoogle Scholar
  23. 23.
    Zhong, W., Lu, H., Yang, M.-H.: Robust object tracking via sparsity-based collaborative model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1838–1845 (2012)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.College of EngineeringHuazhong Agricultural UniversityWuhanChina
  2. 2.College of InformaticsHuazhong Agricultural UniversityWuhanChina

Personalised recommendations