Skip to main content
SpringerLink
Log in

Visual tracking based on adaptive interacting multiple model particle filter by fusing multiples cues

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In visual tracking topic, developing a robust tracking method is very challenging, seen that there are many issues to look at, particularly, fast motion, target appearance changing, background clutter and camera motion. To override these problems, we present a new object tracking method with the fusion of interacting multiple models (IMM) and the particle filter (PF). First, the IMM is applied with a bank of parallel H∞ filter to estimate the global motion, the target motion is efficiently represented using only two parametric single models, and an adaptive strategy is preformed to adjust automatically the parameters of the two sub models at each recursive time step. Second, the particle filter is performed to estimate the local motion, we fuse the color and texture features to describe the appearance of the tracked object, we use the alpha Gaussian mixture model (α-GMM) to model the color feature distribution, the parameter α allows the probability function to possesses a flatter distribution, and the texture feature is represented by the distinctive uniform local binary pattern histogram (DULBP) based on the uniform local binary pattern (ULBP) operator; we fuse then the two features to represent the target’s appearance under the particle filter framework. We conduct quantitative and qualitative experiments on a variety of challenging public sequences; the results show that our method performs robustly and demonstrates strong accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24

Similar content being viewed by others

Notes

  1. EC Funded CAVIAR project/IST 2001 37,540: http://homepages.inf.ed.ac.uk/rbf/CAVIAR/

  2. Visual Tracker Benchmark: http://cvlab.hanyang.ac.kr/tracker_benchmark/datasets.html

References

  1. Alahmadi A, Hussain M, Aboalsamh H, Muhammad G, Bebis G, Mathkour H (2017) Passive detection of image forgery using DCT and local binary pattern. SIViP 11:81–88

    Article  Google Scholar 

  2. Aristidou A, Lasenby J (2013) Real-time marker prediction and Cor-estimation in optical motion capture. Vis Comput 29:7–26

    Article  Google Scholar 

  3. M.S. Arulampalam , S. Maskell , N. Gordon , T. Clapp (2002) A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking, IEEE Transactions on Signal Processing 50(2):174–188.

    Article  Google Scholar 

  4. Bar-Shalom Y, Li XR (1993) Estimation and tracking, principles, techniques and software. Artech House, Boston

    MATH  Google Scholar 

  5. Bhattacharyya A (1943) On a measure of divergence between two statistical populations defined by their probability distributions. Bull Calcutta Math Soc 35(1):99–109

    MathSciNet  MATH  Google Scholar 

  6. Bhimani J, Yang Z, Leeser M (2017) Accelerating big data applications using lightweight virtualization framework on enterprise cloud. High Performance Extreme Computing Conference (HPEC), IEEE

  7. Bhimani J, Mi N, Leeser M (2017) FIM: performance prediction for parallel computation in iterative data processing applications. Cloud Computing (CLOUD), 2017 I.E. 10th International Conference on

  8. Cai Z, Gu Z, Yu ZL, Liu H, Zhang K (2016) A real-time visual object tracking system based on Kalman filter and MB-LBP feature matching. Multimedia Tools Appl 75(4):2393–2409

    Article  Google Scholar 

  9. Cui J, Member, IEEE, Liu Y, Xu Y, Zhao H, Zha H (2013)(IEEE Transactions on Systems, Man, and Cybernetics: Systems Tracking generic human motion via fusion of low- and high-dimensional approaches. IEEE Trans Syst Man Cybern Syst 43(4)

    Article  Google Scholar 

  10. Dhassi Y, Aarab A, Alfidi M (2017) Robust visual tracking based on H∞ particle filter by adaptively integrating multiple cues. Int J Imaging Robot 17(1)

  11. Dou J, Li J (2014) Robust visual tracking based on interactive multiple model particle filter by integrating multiple cues. Neurocomputing 135:118–129

    Article  Google Scholar 

  12. Fan Z, Ji H, Zhang Y (2015) Iterative particle filter (IPF) for visual tracking. Image Commun 36(C):140–153

    Google Scholar 

  13. Frank LL, Lihua X, Dan P (2007) Optimal and Robust Estimation. CRC Press, Boca Raton

    Google Scholar 

  14. Hu L, Li Z, Liu H (2015) Age group estimation on single face image using blocking ULBP and SVM. Chinese Intelligent Automation Conference, pp 431–438

  15. Karasulu B, Korukoglu S (2011) A software for performance evaluation and comparison of people detection and tracking methods in video processing. Multimedia Tools Appl 55(3):677–723

    Article  Google Scholar 

  16. Karavasilis V, Nikou C, Likas A (2015) Visual tracking using spatially weighted likelihood of Gaussian mixture. Comput Vis Image Underst 140:43–57

    Article  Google Scholar 

  17. Kristan M (2008) Tracking people in video data using probabilistic models. Ph.D. dissertation, Faculty Elect. Eng., Univ. Ljubljana

  18. Li P, Zhang T, Pece AEC (2003) Visual contour tracking based on particle filters. Image Vis Comput 21:111–123

    Article  Google Scholar 

  19. Liu Y, Zhang X, Cui J, Wu C, Aghajan H, Zha H (2010) Visual analysis of child-adult interactive behaviors in video sequences. 2010 I.E. 16th International Conference on Virtual Systems and Multimedia (VSMM)

  20. Liu Y, Zhao H, Zha H (2012) Fusion of low-and high-dimensional approaches by trackers sampling for generic human motion tracking. 2012 21st International Conference on Pattern Recognition (ICPR)

  21. Liu Y, Nie L, Han L, Zhang L, David S Rosenblum (2016) Action2activity: recognizing complex activities from sensor data. 2015 24th International Conference on Artificial Intelligence (IJCAI)

  22. Liu L, Cheng L, Liu Y, Jia Y, Rosenblum DS (2016) Recognizing complex activities by a probabilistic interval-based model. 2016 30th National Conference on Artificial Intelligence (AAAI)

  23. Liu Z, Song Y-q, Xie C-h, Tang Z (2016) A new clustering method of gene expression data based on multivariate Gaussian mixture models. SIViP 10(2):359–368

    Article  Google Scholar 

  24. Lu Y, Wei Y, Liu L, Zhong J, Sun L, Liu Y (2017) Towards unsupervised physical activity recognition using smartphone accelerometers. Multimedia Tools Appl 76(8):10701–10719

    Article  Google Scholar 

  25. Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on feature distributions. Pattern Recognition 29(1):51–59

    Article  Google Scholar 

  26. Pan Z, Liu S, Fu W (2017) A review of visual moving target tracking. Multimedia Tools and Applications,Volume 76, Issue 16, pp 16989–17018.

    Article  Google Scholar 

  27. Roemer J, Groman M, Yang Z (2015) Improving virtual machine migration via deduplication. 2014 I.E. 11th International Conference on Mobile Ad Hoc and Sensor Systems

  28. Rong Li X, Jilkov VP (2004) Survey of maneuvering target tracking. Part I. Dynamic models. IEEE Trans Aerosp Electron Syst 39:1333–1364

    Article  Google Scholar 

  29. Smeulders AWM, Chu DM, Cucchiara R (2014) Visual tracking: an experimental survey. IEEE Trans Pattern Anal Mach Intell 36(7):1442–1468.

  30. Sobral A, Vacavant A (2014) A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos. Comput Vis Image Underst 14:4–21

    Article  Google Scholar 

  31. Sun W, Li X, Qiu J, Wang F (2014) Iterated unscented Kalman particle filter for visual tracking. J Comput Inf Syst 10(2):681–689

    Google Scholar 

  32. Sun X, Yao H, Lu X (2014) Dynamic multi-cue tracking using particle filter. SIViP 8:95–101

    Article  Google Scholar 

  33. Tamrakar D, Khanna P (2015) Occlusion invariant Palmprint recognition with ULBP histograms. Procedia Comput Sci 54:491–500

    Article  Google Scholar 

  34. Walia GS, Kapoor R (2016) Robust object tracking based upon adaptive multi-cue integration for video surveillance. Multimedia Tools Appl 75:15821–15847

    Article  Google Scholar 

  35. Wang X, Wang Y, Wan W, Hwang J-N (2014) Object tracking with sparse representation and annealed particle filter. SIViP 8:1059–1068

    Article  Google Scholar 

  36. Wang J, Wang T, Yang Z (2016) eSplash: efficient speculation in large scale heterogeneous computing systems. Performance Computing and Communications Conference (IPCCC), 2016 I.E. 35th International Conference on

  37. Wang T, Wang J, Nguyen SN (2017) EA2S2: an efficient application-aware storage system for big data processing in heterogeneous clusters. Published in: Computer Communication and Networks (ICCCN), 2017 26th International Conference on

  38. Wu D (2009) Parameter estimation for α-GMM based on maximum likelihood criterion. Neural Comput 21:1776–1795

    Article  MathSciNet  Google Scholar 

  39. Wu S, Hong L (2005) Hand tracking in a natural conversational environment by the interacting multiple model and probabilistic data association (IMM-PDA) algorithm. Pattern Recogn 38(11):2143–2158

    Article  Google Scholar 

  40. Xu Y, Dong J, Zhang B, Xu D (2016) Background modeling methods in video analysis: a review and comparative evaluation. CAAI Trans Intell Tech 1(1):43–60

    Article  Google Scholar 

  41. Xu Q, Wang Z, Wang F, Li J. (2018) Thermal comfort research on human CT data modeling. Multimedia Tools Appl 77(5):6311–6326.

    Article  MathSciNet  Google Scholar 

  42. Yang Z, Awasthi M, Ghosh M (2017) A fresh perspective on total cost of ownership models for flash storage in datacenters. Cloud Computing Technology and Science (CloudCom), 2016 I.E. International Conference on

  43. Yang Z, Tai J, Bhimani J (2016) GREM. Dynamic SSD resource allocation in virtualized storage systems with heterogeneous IO workloads. Performance Computing and Communications Conference (IPCCC), 2016 I.E. 35th International Conference on.

  44. Yin S, Na JH, Choi JY, Oh S (2011) Hierarchical Kalman-particle filter with adaptation to motion changes for object tracking. Comput Vis Image Underst 115:885–900

    Article  Google Scholar 

  45. Yu W, Gan L, Yang S, Ding Y, Jiang P, Wang J, Li S (2014) An improved LBP algorithm for texture and face classification. SIViP 8:155–161

    Article  Google Scholar 

  46. Zhao Z, Wang T, Liu F, Choe G, Yuan C, Cui Z (2017) Remarkable local resampling based on particle filter for visual tracking. Multimedia Tools Appl 76:835–860

    Article  Google Scholar 

  47. Zhou Z, Wu D, Zhu Z (2016) Object tracking based on Kalman particle filter with LSSVR. Int J Light Electron Optics 127(2):613–619

    Article  Google Scholar 

  48. Zhu H, Guo K, Chen S (2016) Fusion of Gaussian mixture models for maneuvering target tracking in the presence of unknown cross-correlation. Chin J Electron, Volume: 25, Issue: 2, Pages 270 - 276.

Download references

Author information

Authors and Affiliations

  1. Laboratory of Electronics, Signals, Systems and Computers, Department Of Physics Faculty of Sciences Dhar- Mahraz, Sidi Mohamed Ben Abdellah University, Fes, Morocco

    Younes Dhassi & Abdellah Aarab

Authors
  1. Younes Dhassi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abdellah Aarab
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Younes Dhassi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dhassi, Y., Aarab, A. Visual tracking based on adaptive interacting multiple model particle filter by fusing multiples cues. Multimed Tools Appl 77, 26259–26292 (2018). https://doi.org/10.1007/s11042-018-5852-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-5852-5

Keywords

Search

Navigation