Advertisement

Multi-scale Region Proposal Network Trained by Multi-domain Learning for Visual Object Tracking

  • Yang Fang
  • Seunghyun Ko
  • Geun-Sik Jo
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10636)

Abstract

This paper presents a multi-scale region proposal network (RPN) for visual object tracking, inspired by Faster R-CNN and Yolo detectors which adopt an RPN to significantly speed up the detection time and achieve state-of-the-art detection performance. We expand them to apply a multi-scale region proposal network for visual tracking. Our proposed network can utilize both fine-grained features from shallow convolutional layers and discriminative features from deep convolutional layers. The features of shallow layers are good at accurate objects localization, and the features of deep convolutional layers can efficiently distinguish between target objects and backgrounds. A multi-domain learning mechanism is applied to train our network in an end-to-end way. To predict a new target object and its location in a new frame, we propose an re-ranking algorithm to determine a true object by exploiting spatial modeling, scale variants and color attributes of object proposals. Our tracker is validated on the OTB-15 object tracking benchmark, and achieves 0.603 for the success rate and 0.760 for the precision rate of the one-pass evaluation. Additionally, our tracker can run at 22 frames per second, which is very close to real-time speed. Experiment results show its outstanding performance in both tracking accuracy and speed by comparing it with existing state-of-the-art methods.

Keywords

Color attributes Multi-domain learning Multi-scale RPN Re-ranking algorithm Visual tracking 

Notes

Acknowledgments

This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) (No. 2015-R1A2A2A03006190) and also supported by Nvidia GPU Grant.

References

  1. 1.
    Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking-learning-detection. IEEE Trans. Pattern Anal. Mach. Intell. 34(1), 1409–1422 (2010)Google Scholar
  2. 2.
    Zhang, J., Ma, S., Sclaroff, S.: MEEM: robust tracking via multiple experts using entropy minimization. In: European Conference on Computer Vision, pp. 188–203 (2014)Google Scholar
  3. 3.
    Hare, S., Saffari, A., Torr, P.H.S.: Struck: structured output tracking with kernels. IEEE Trans. Pattern Anal. Mach. Intell. 38(10), 2096–2109 (2016)CrossRefGoogle Scholar
  4. 4.
    Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2411–2418 (2013)Google Scholar
  5. 5.
    Zhu, G., Porikli, F., Li, H.: Beyond local search: tracking objects everywhere with instance-specific proposals. In: IEEE Computer Vision and Pattern Recognition, pp. 943–951 (2016)Google Scholar
  6. 6.
    Ma, C., Huang, J.B., Yang, X., Yang, M.H.: Hierarchical convolutional features for visual tracking. In: IEEE International Conference on Computer Vision, pp. 3074–3082 (2015)Google Scholar
  7. 7.
    Danelljan, M., Khan, F., Felsberg, M., van de Weijer, J.: Learning spatially regularized correlation filters for visual tracking. In: IEEE International Conference on Computer Vision, pp. 4310–4318 (2015)Google Scholar
  8. 8.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409.1556 (2014)Google Scholar
  9. 9.
    Luca, B., Jack, V., Andrea, V., Philip, T.: Fully-convolutional Siamese networks for object tracking. In: European Conference on Computer Vision, pp. 850–865 (2016)Google Scholar
  10. 10.
    Nam, H., Han, B.: Learning multi-domain convolutional neural networks for visual tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 4293–4302 (2016)Google Scholar
  11. 11.
    Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)Google Scholar
  12. 12.
    Girshick, R.: Fast R-CNN. In: IEEE International Conference on Computer Vision, pp. 1440–1448 (2015)Google Scholar
  13. 13.
    Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., Torr, P.H.S.: Staple: complementary learners for real-time tracking. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1401–1409 (2016)Google Scholar
  14. 14.
    Danelljan, M., Hager, G., Shahbaz Khan, F., Felsberg, M.: Accurate scale estimation for robust visual tracking. In: British Machine Vision Conference (2014). doi: 10.5244/C.28.65
  15. 15.
    Qi, Y., Zhang, S., Qin, L., Yao, H., Huang, Q., M.-H.Yang, J.L.: Hedged deep tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 4303–4311 (2016)Google Scholar
  16. 16.
    Danelljan, M., Khan, F., Felsberg, M., van de Weijer, J.: Adaptive color attributes for real-time visual tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1090–1097 (2014)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.School of Computer and Information EngineeringInha UniversityIncheonSouth Korea

Personalised recommendations