Face tracking often encounters drifting problems, especially when a significant face appearance variation occurs. Many trackers suffer from the difficulty of facial feature extraction during a wide range of face turning, occlusion, and even invisibleness. In this paper, we propose a novel and efficient fusion strategy for robust face tracking. A Supervised Descent Method (SDM) and a Compressive Tracking method (CT) are employed at the same time. SDM is used to correct drifting errors of CT continuously during frontal face tracking. However, when the face orientation changes to the angle orthogonal to the view line, it results in tracking failure for the SDM method. CT is then adopted to keep the face region being tracked until SDM detects and tracks the face again. In the experiments, we test the proposed method for real-time tracking using several challenging sequences from recent literatures. The fusion strategy has achieved encouraging performance in terms of both efficiency and reliability.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Babenko B, Yang MH, Belongie S (2011) Robust object tracking with online multiple instance learning. IEEE Trans Pattern Anal Mach Intell 33(8):1619–1632
Candes EJ, Tao T (2005) Decoding by linear programming. IEEE Trans Inf Theory 51(12):4203–4215
Candes EJ, Tao T (2006) Near-optimal signal recovery from random projections: universal encoding strategies? IEEE Trans Inf Theory 52(12):5406–5425
Demirkus M, Clark JJ, Arbel T (2014) Robust semi-automatic head pose labeling for real-world face video sequences. Multimed Tools Appl 70(1):495–523
Donoho DL (2006) Compressed sensing. IEEE Trans Inf Theory 52(4):1289–1306
Grabner H, Leistner C, Bischof H (2008) Semi-supervised on-line boosting for robust tracking. Comput Vis Eccv 5302:234–247, Pt I, Proceedings
Hu CL et al (2014) An effective head pose estimation approach using Lie Algebrized Gaussians based face representation. Multimed Tools Appl 73(3):1863–1884
Huang C et al (2007) High-performance rotation invariant multiview face detection. IEEE Trans Pattern Anal Mach Intell 29(4):671–686
Jones MVP (2003) Fast multi-view face detection. Technical Report TR2003-96, Mitsubishi Electric Research Laboratories, Jul. 2003
Kaneko T, Hori O (2002) Template update criterion for template matching of image sequences. 16th International Conference on Pattern Recognition, Vol Ii, Proceedings, 1–5
Li HX, Shen CH, Shi QF (2011) Real-time visual tracking using compressive sensing. 2011 I.E. Conf Comput Vis Pattern Recogn (Cvpr), 1305–1312
Matthews I, Ishikawa T, Baker S (2004) The template update problem. IEEE Trans Pattern Anal Mach Intell 26(6):810–815
Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154
Wright J et al (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227
Wu Y, Lim J, Yang MH (2013) Online object tracking: a benchmark. 2013 I.E. Conf Comput Vis Pattern Recogn (Cvpr), 2411–2418
Xiong XH, De la Torre F (2013) Supervised descent method and its applications to face alignment. 2013 I.E. Conf Comput Vis Pattern Recogn (Cvpr), 532–539
Xu R, Gu XD, Wei BJ (2013) An improved real time compressive tracking. 2013 Second Iapr Asian Conference on Pattern Recognition (Acpr 2013), 2013:692–696
Yu H, Liu HH (2014) Regression-based facial expression optimization. IEEE Trans Human-Mach Syst 44(3):386–394
Zeisl B, et al (2010) On-line semi-supervised multiple-instance boosting. 2010 I.E. Conf Comput Vis Pattern Recogn (Cvpr), 1879–1886
Zhang KH, Zhang L, Yang MH (2012) Real-time compressive tracking. Comput Vis Eccv 7574:864–877, Pt Iii
Zhang TZ et al (2012) Low-rank sparse learning for robust visual tracking. Comput Vis Eccv 7577:470–484, Pt Vi
This work is partially supported by the State Scholarship Fund of China. Y. Lu is supported by the Natural Science Foundation of Heilongjiang Province of China under Grant F201428 and the 12th Five-Year-Plan in Key Science and Technology Research of agricultural bureau in Heilongjiang province of China under Grant HNK125B-04-03.
About this article
Cite this article
Jiang, X., Yu, H., Lu, Y. et al. A fusion method for robust face tracking. Multimed Tools Appl 75, 11801–11813 (2016). https://doi.org/10.1007/s11042-015-2659-5
- Fusion algorithm
- Human face tracking
- Compressive tracking
- Supervised descend method