Abstract
Recently, computer vision and multimedia understanding become important research domains in computer science. Meanwhile, visual tracking of moving target, one of most important application in computer vision, becomes a highlight today. So, this paper reviews research and technology in this domain. First, background and application of visual tracking is introduced. Then, visual tracking methods are classified by different thinking and technologies. Their positiveness, negativeness and improvement are analyzed deeply. Finally, difficulty in this domain is summarized and future prospect of related fields is presented.
Similar content being viewed by others
References
Abdel-Hakim AE, Farag AA (2006) CSIFT: A SIFT descriptor with color invariant characteristics//Computer Vision and Pattern Recognition, 2006 I.E. Computer Society Conference on. IEEE 2:1978–1983
Agrafiotis D, Davies SJC, Canagarajah N et al (2007) Towards efficient context-specific video coding based on gaze-tracking analysis. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 3(4):4
Aitfares W, Bouyakhf EH, Herbulot A et al (2013) Hybrid region and interest points-based active contour for object tracking. Appl Math Sci 7(118):5879–5899
Allili MS, Ziou D (2008) Object tracking in videos using adaptive mixture models and active contours. Neurocomputing 71(10):2001–2011
Babenko B, Yang MH, Belongie S (2011) Robust object tracking with online multiple instance learning. Pattern Analysis and Machine Intelligence, IEEE Transactions on 33(8):1619–1632
Bao C, Wu Y, Ling H et al (2012) Real time robust l1 tracker using accelerated proximal gradient approach//Computer Vision and Pattern Recognition (CVPR), 2012 I.E. Conference on. IEEE:1830–1837
Bay H, Tuytelaars T, Gool LV (2006) SURF: speeded up robust features. Computer Vision & Image Understanding 110(3):404–417
Beauchemin SS, Barron JL (1995) The computation of optical flow. ACM Computing Surveys (CSUR) 27(3):433–466
Birchfield ST, Rangarajan S (2005) Spatiograms versus histograms for region-based tracking//Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on. IEEE 2:1158–1163
Bosch A, Zisserman A, Muoz X (2008) Scene classification using a hybrid generative/discriminative approach. Pattern Analysis and Machine Intelligence, IEEE Transactions on 30(4):712–727
Brox T, Rousson M, Deriche R et al (2010) Colour, texture, and motion in level set based segmentation and tracking. Image and Vision Computing 28(3):376–390
Cai Z, Wen L, Lei Z et al (2014) Robust deformable and occluded object tracking with dynamic graph. Image Processing, IEEE Transactions on 23(12):5497–5509
Chen Z (2003) Bayesian filtering: fKalman filters to particle filters, and beyond. Statistics 182(1):1–69
Cheng Y (1995) Mean shift, mode seeking, and clustering. Pattern Analysis and Machine Intelligence, IEEE Transactions on 17(8):790–799
Chiverton J, Xie X, Mirmehdi M (2012) Automatic bootstrapping and tracking of object contours. Image Processing, IEEE Transactions on 21(3):1231–1245
Choi JW, Whangbo TK, Kim CG (2015) A contour tracking method of large motion object using optical flow and active contour model. Multimedia Tools and Applications 74(1):199–210
Chu DM, Smeulders AWM (2010) Color invariant surf in discriminative object tracking,” in Proc. IEEE ECCV, Heraklion
Cohen LD (1991) On active contour models and balloons. CVGIP: Image understanding 53(2):211–218
Coifman B, Beymer D, McLauchlan P et al (1998) A real-time computer vision system for vehicle tracking and traffic surveillance. Transportation Research Part C: Emerging Technologies 6(4):271–288
Collins RT (2003) Mean-shift blob tracking through scale space//Computer Vision and Pattern Recognition, 2003. Proceedings. 2003 I.E. Computer Society Conference on. IEEE, 2: II-234-40 vol. 2
Collins RT, Liu Y, Leordeanu M (2005) Online selection of discriminative tracking features. Pattern Analysis and Machine Intelligence, IEEE Transactions on 27(10):1631–1643
Collins R, Zhou X, Seng KT (2005) An open source tracking testbed and evaluation web site. Perf.eval.track. & Surveillance
Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. Pattern Analysis and Machine Intelligence, IEEE Transactions on 24(5):603–619
Comaniciu D, Ramesh V, Meer P (2000) Real-time tracking of non-rigid objects using mean shift, BEST PAPER AWARD, IEEE Conf. Computer Vision and Pattern Recognition (CVPR’00), Hilton Head Island, South Carolina 2:142–149
Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. Pattern Analysis and Machine Intelligence, IEEE Transactions on 25(5):564–577
Cuenca C, González E, Trujillo A et al (2015) Fast and accurate circle tracking using active contour models. J Real-Time Image Process:1–10
Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. Computer Vision and Pattern Recognition 1:886–893
Danelljan M, Hager G, Shahbaz Khan F et al (2015) Learning spatially regularized correlation filters for visual tracking//Proceedings of the IEEE International Conference on Computer Vision:4310–4318
Fisher RB (2004) The PETS04 surveillance ground-truth data sets. Proc. Sixth IEEE Int. Work. on Performance Evaluation of Tracking and Surveillance (PETS04)
Fu W, Zhou J, Liu S et al (2014) Differential trajectory tracking with automatic learning of background reconstruction. Multimedia Tools & Applications. doi:10.1007/s11042-014-2391-6
Fu W, Zhou J, An C (2015) Distributed dynamic target tracking method by block diagonalization of topological matrix. Journal of Supercomputing. doi:10.1007/s11227-015-1499-4
Fu W, Zhou J, Ma Y (2015) Moving tracking with approximate topological isomorphism. Multimedia Tools & Applications. doi:10.1007/s11042-015-2519-3
Fukunaga K, Hostetler LD (1975) The estimation of the gradient of a density function, with applications in pattern recognition. Information Theory, IEEE Trans 21(1):32–40
Gress O, Posch S (2012) Trajectory retrieval from Monte Carlo data association samples for tracking in fluorescence microscopy images//Biomedical Imaging (ISBI), 2012 9th IEEE International Symposium on. IEEE:374–377
Guo S, Shi X, Wang Y et al (2016) Non-rigid object tracking using modified mean-shift method//Information Science and Applications (ICISA) 2016. Springer Singapore:451–458
Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507
Hong S, Bolić M, Djuric PM (2012) An efficient fixed-point implementation of residual resampling scheme for high-speed particle filters. IEEE Signal Processing Letters 11(5):482–485
Hong S, Shi Z, Wang L et al (2013) Adaptive regularized particle filter for synchronization of chaotic colpitts circuits in an AWGN Channel. Circuits Systems & Signal Processing 32(2):825–841
Horn B K, Schunck B G (1981) Determining optical flow//1981 Technical symposium east. Int Soc Optics Photon:319–331
Hou Z, Han C (2006) A survey of visual tracking. Acta Automatica Sinica 32(4):603–617
Huang K, Chen X, Kang Y et al (2015) Intelligent visual surveillance: a review. Chinese Journal of Computers 38(6):1093–1118
Huang Y, Liu Z (2015) Segmentation and tracking of lymphocytes based on modified active contour models in phase contrast microscopy images. Comput Math Methods Med 2015
Hwang SS, Speyer JL (2011) Particle filters with adaptive resampling technique applied to relative positioning using GPS carrier-phase measurements. IEEE Transactions on Control Systems Technology 19(19):1384–1396
Jatoth RK, Gopisetty S, Hussain M (2015) Performance analysis of alpha beta filter, kalman filter and meanshift for object tracking in video sequences. International Journal of Image, Graphics and Signal Processing (IJIGSP) 7(3):24
Jeyakar J, Babu RV, Ramakrishnan KR (2008) Robust object tracking with background-weighted local kernels. Computer Vision and Image Understanding 112(3):296–309
Jia X, Lu H, Yang MH (2012) Visual tracking via adaptive structural local sparse appearance model//Computer vision and pattern recognition (CVPR), 2012 I.E. Conference on. IEEE:1822–1829
Jia D, Zhang L, Li C (2015) The improvement of mean-shift algorithm in target tracking. International Journal of Security and Its Applications 9(2):21–28
Kalal Z, Mikolajczyk K, Matas J (2012) Tracking-learning-detection. Pattern Analysis and Machine Intelligence, IEEE Transactions on 34(7):1409–1422
Kalton G (2014) Systematic sampling//Wiley StatsRef: Statistics Reference Online. Wiley
Kass M, Witkin A, Terzopoulos D (1988) Snakes: active contour models. International journal of computer vision 1(4):321–331
Ke Y, Sukthankar R (2004) PCA-SIFT: A more distinctive representation for local image descriptors//Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004 I.E. Computer Society Conference on. IEEE 2: II-506-II-513 Vol. 2
Kotecha JH, Djurić PM (2003) Gaussian particle filtering. Signal Processing, IEEE Transactions on 51(10):2592–2601
Kristan M, Matas J, Leonardis A et al (2015) The Visual Object Tracking VOT2015 challenge results//Proceedings of the IEEE International Conference on Computer Vision Workshops:1–23.
Kwok C, Fox D, Meila M (2004) Real-time particle filters. Proceedings of the IEEE 92(3):469–484
Kwon J, Lee KM, Park FC (2009) Visual tracking via geometric particle filtering on the affine group with optimal importance functions//Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on. IEEE:991–998
Leichter I (2012) Mean shift trackers with cross-bin metrics. Pattern Analysis and Machine Intelligence, IEEE Transactions on 34(4):695–706
Li X, Hu W, Shen C et al (2013) A survey of appearance models in visual object tracking. ACM transactions on Intelligent Systems and Technology (TIST) 4(4):58
Li A, Lin M, Wu Y et al (2016) NUS-PRO: a new visual tracking challenge. IEEE Transactions on Pattern Analysis & Machine Intelligence 38(2):335–349
Li S, Wu O, Zhu C et al (2014) Visual object tracking using spatial context information and global tracking skills. Computer Vision and Image Understanding 125:1–15
Li X, Wu F, Hu Z (2005) Convergence of a mean shift algorithm. Journal of Software 16(3):365–374
Lowe DG (1999) Object recognition from local scale-invariant features//Computer vision, 1999. The proceedings of the seventh IEEE international conference on. Ieee 2:1150–1157
Lowe DG (2004) Distinctive image features from scale-invariant key points. International journal of computer vision 60(2):91–110
Lucas BD, Kanade T (1981) An iterative image registration technique with an application to stereo vision. IJCAI 81:674–679
Masoud O, Papanikolopoulos NP (2001) A novel method for tracking and counting pedestrians in real-time using a single camera. Vehicular Technol, IEEE Trans 50(5):1267–1278
Mei X, Ling H (2009) Robust visual tracking using L1 minimization//Computer Vision, 2009 I.E. 12th International Conference on. IEEE:1436–1443
Menet S, Saint-Marc P, Medioni G (1990) B-snakes: implementation and application to stereo//proceedings DARPA 720:726
Mondal A, Ghosh S, Ghosh A (2016) Efficient silhouette-based contour tracking using local information. Soft Computing 20(2):785–805
Morel JM, Yu G (2009) ASIFT: a new framework for fully affine invariant image comparison. SIAM Journal on Imaging Sciences. SIAM J Imaging Sci 2(2):438–469
Nam H, Han B (2015) Learning multi-domain convolutional neural networks for visual tracking. Comput Sci
Nieto M, Cortés A, Otaegui O et al (2016) Real-time lane tracking using Rao-Blackwellized particle filter. Journal of Real-Time Image Processing 11(1):179–191
Ning J, Zhang L, Zhang D et al (2013) Joint registration and active contour segmentation for object tracking. Circuits and Systems for Video Technology, IEEE Transactions on 23(9):1589–1597
Oron S, Bar-Hillel A, Levi D et al (2015) Locally orderless tracking. International Journal of Computer Vision 111(2):213–228
Pai CJ, Tyan HR, Liang YM et al (2004) Pedestrian detection and tracking at crossroads. Pattern Recognition 37(5):1025–1034
Peng N, Yang J, Liu Z et al (2005) Automatic selection of kernel-bandwidth for mean-shift object tracking. Journal of Software 16(9):1542–1550
Rosenfeld A (2001) From image analysis to computer vision: an annotated bibliography, 1955–1979. Computer Vision and Image Understanding 84(2):298–324
Shaul Oron DL, Aharon B-H, Avidan S (2012) Locally orderless tracking,” in Proc. IEEE CVPR, Providence
Smeulders AWM, Chu DM, Cucchiara R et al (2014) Visual tracking: an experimental survey. Pattern Analysis and Machine Intelligence, IEEE Transactions on 36(7):1442–1468
Sun S, Guo Q, Dong F et al (2013) On-line boosting based real-time tracking with efficient hog//Acoustics, Speech and Signal Processing (ICASSP), 2013 I.E. International Conference on. IEEE:2297–2301
Sun X, Yao H, Zhang S et al (2015) Non-rigid object contour tracking via a novel supervised level set model. Image Processing, IEEE Transactions on 24(11):3386–3399
Tao X, Shaogang G (2006) Beyond tracking: modeling activity and understanding behavior. Int J Comput Vis
Vezzani R, Cucchiara R (2010) Video surveillance online repository (visor): an integrated framework. Multimedia Tools and Applications 50(2):359–380
Vojir T, Noskova J, Matas J (2014) Robust scale-adaptive mean-shift for tracking. Pattern Recognition Letters 49:250–258
Wang Z, Hong K (2012) A new method for robust object tracking system based on scale invariant feature transform and camshaft //Proceedings of the 2012 ACM Research in Applied Computation Symposium. ACM:132–136
Wang N, Shi J, Yeung D Y et al (2015) Understanding and diagnosing visual tracking systems//Proceedings of the IEEE International Conference on Computer Vision:3101–3109
Wang H, Wang J, Ren M et al (2009) A new robust object tracking algorithm by fusing multi-features. Journal of Image and Graphics 14(3):489–498
Wu Y, Lim J, Yang MH (2013) Online object tracking: a benchmark//IEEE Conference on Computer Vision & Pattern Recognition:2411–2418
Xia C, Sun S F, Chen P et al (2014) Haar-like and HOG fusion based object tracking//Advances in Multimedia Information Processing–PCM 2014. Springer International Publishing:173–182
Xie Z, Wei Z, Bai C (2015) Multi-aircrafts tracking using spatial–temporal constraints-based intra-frame scale-invariant feature transform feature matching. Computer Vision, IET 9(6):831–840
Xu F, Gao M (2010) Human detection and tracking based on HOG and particle filter//Image and Signal Processing (CISP), 2010 3rd International Congress on. IEEE 3:1503–1507
Yan H, Dechant CM, Moradkhani H (2015) Improving soil moisture profile prediction with the particle filter-markov chain Monte Carlo method. IEEE Transactions on Geoscience & Remote Sensing 53(11):6134–6147
Yang F, Lu H, Yang MH (2014) Robust superpixel tracking. Image Processing, IEEE Transactions on 23(4):1639–1651
Yi S, He Z, You X et al (2015) Single object tracking via robust combination of particle filter and sparse representation. Signal Processing 110:178–187
Yilmaz A, Javed O, Shah M (2006) Object tracking: a survey. Acm computing surveys (CSUR) 38(4):13
Youm S, Liu S (2015) Development healthcare PC and multimedia software for improvement of health status and exercise habits. Multimedia Tools and Applications. doi:10.1007/10.1007/s11042-015-2998-2
Zhong W, Lu H, Yang MH (2012) Robust object tracking via sparsity-based collaborative model//Computer vision and pattern recognition (CVPR), 2012 I.E. Conference on. IEEE:1838–1845
Zhou Z, Zhou M, Li J (2016) Object tracking method based on hybrid particle filter and sparse representation. Multimed Tools Appl:1–15
Zhu Q, Yeh MC, Cheng KT et al (2006) Fast human detection using a cascade of histograms of oriented gradients//Computer Vision and Pattern Recognition, 2006 I.E. Computer Society Conference on. IEEE 2:1491–1498
Acknowledgments
This research is supported by following grants:
National Natural Science Foundation of China [61502254] and National Natural Science Foundation of Inner Mongolia [2014BS0606].
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pan, Z., Liu, S. & Fu, W. A review of visual moving target tracking. Multimed Tools Appl 76, 16989–17018 (2017). https://doi.org/10.1007/s11042-016-3647-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-016-3647-0