Skip to main content

Advertisement

SpringerLink
Log in

A new deformable mesh model for face tracking using edge based features and novel sets of energy functions

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents a new method for automatic human face locating and tracking. The proposed method consists of two modules including face locating and face tracking. The face locating module has a hierarchical structure, which consists of a skin color classifier together with AdaBoost based face detectors. The face tracking module is considered to be the main contribution of the paper. The module is based on the unstructured 2-D triangular deformable meshes, which employs a new robust and illumination insensitive feature extraction and matching algorithms as well as new sets of mesh energy functions. The feature extraction and matching algorithms are established upon edge points and their representation using fuzzy set theory, which is called fuzzy edges. For matching features, a multiresolution algorithm is utilized based on fuzzy edges and edge pyramid. The new mesh energy functions are also employed to manage both rigid and non-rigid motions in the head and face. Experimental results demonstrate the accuracy and stability of the proposed method for both face locating and face tracking.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Barber CB, Dobkin DP, Huhdanpaa H (1996) The quickhull algorithm for convex hulls. ACM Trans Math Softw (TOMS) 22(4):469–483

    Article  MATH  MathSciNet  Google Scholar 

  2. Behrad A, Motamedi SA (2003) Moving target detection and tracking using edge features detection and matching. IEICE Trans Inf Syst 86(12):2764–2774

    Google Scholar 

  3. Bouguet J (2000) Pyramidal implementation of the lucas kanade feature tracker–description of the algorithm. Intel Corporation, Microprocessor Research Labs

  4. Bradski G, Kaehler A (2008) Learning OpenCV: Computer vision with the OpenCV library. O’reilly Media Inc

  5. Cai J, Goshtasby A (1999) Detecting human faces in color images. Image Vis Comput 18(1):63–75

    Article  Google Scholar 

  6. Corcoran P, Ionita MC, Bacivarov I (2007) Next generation face tracking technology using aam techniques. In: International Symposium on Signals, Circuits and Systems (ISSCS 2007), IEEE, vol 1 , pp 1–4

  7. Er MJ, Chen W, Wu S (2005) High-speed face recognition based on discrete cosine transform and rbf neural networks. IEEE T Neural Networ 16(3):679–691

    Article  Google Scholar 

  8. Essannouni L, Elhaj E, Aboutajdine D (2008) Automatic color face tracking using gray information. In: IEEE Symposium on Computers and Communications(ISCC 2008), IEEE, pp 1010–1014

  9. Fatahi M, Nadjafi M, Al-Din Makki S V (2013) Improving the performance of skin segmentation in quasi-skin regions via multiple classifier system. In: 8th Iranian Conference on Machine Vision and Image Processing (MVIP), IEEE, pp 333–338

  10. Georgia Tech face database (Accessed Dec. 2013) Online:. http://www.anefian.com/research/gt_db.zip

  11. Guan Y, Yang L (2006) An unsupervised face detection based on skin color and geometric information. In: Sixth International Conference on Intelligent Systems Design and Applications (ISDA’06), IEEE, vol 2, pp 272–276

  12. Gunn SR, Nixon MS (1994) A dual active contour for head boundary extraction. In: IEE Colloquium on Image Processing for Biometric Measurement, IET, pp 6–1

  13. Hsieh IS, Fan KC, Lin C (2002) A statistic approach to the detection of human faces in color nature scene. Pattern Recogn 35(7):1583–1596

    Article  MATH  Google Scholar 

  14. Huang C, Ai H, Li Y, Lao S (2007) High-performance rotation invariant multiview face detection. IEEE T Pattern Anal 29(4):671–686

    Article  Google Scholar 

  15. Jamasbi B, Motamedi SA, Behrad A (2007) Contour tracking of targets with large aspect change. JMM 2(6):7–14

    Article  Google Scholar 

  16. Jones M, Viola P (2003) Fast multi-view face detection. Mitsubishi Electric Research Lab TR-20003-96, vol 3, p 14

  17. Jones MJ, Rehg JM (2002) Statistical color models with application to skin detection. Int J Comput Vis 46(1):81–96

    Article  MATH  Google Scholar 

  18. Kasturi R, Goldgof D, Soundararajan P, Manohar V, Garofolo J, Bowers R, Boonstra M, Korzhova V, Zhang J (2009) Framework for performance evaluation of face, text, and vehicle detection and tracking in video: Data, metrics, and protocol. IEEE T Pattern Anal 31(2):319–336

    Article  Google Scholar 

  19. Kim EY, Park SH (2006) Computer interface using eye tracking for handicapped people. In: 7th International Conference on Intelligent Data Engineering and Automated Learning (IDEAL 2006). Springer, pp 562–569

  20. Kruppa H, Schiele B (2003) Using local context to improve face detection. In: British Machine Vision Conference(BMVC), pp 1–10

  21. Lee YH, Jeong MH, Lee JJ, Jie MS (2007) A robust face tracking using stereo camera. In: SICE, 2007 Annual Conference, IEEE, pp 1985–1989

  22. Lin C, Fan K C (2001) Triangle-based approach to the detection of human face. Pattern Recogn 34(6):1271–1284

    Article  MATH  Google Scholar 

  23. Lucey P, Cohn JF, Kanade T, Saragih J, Ambadar Z, Matthews I (2010) The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), IEEE, pp 94–101

  24. Metaxas D, Tsechpenakis G, Li Z, Huang Y, Kanaujia A (2006) Dynamically adaptive tracking of gestures and facial expressions. In: Computational Science–ICCS 2006. Springer, pp 554–561

  25. Mitra S, Acharya T (2007) Gesture recognition: A survey. IEEE Trans Syst Man Cybern Part C Appl Rev 37(3):311–324

    Article  Google Scholar 

  26. Molloy D, Whelan P F (2000) Active-meshes. Pattern Recogn Lett 21(12):1071–1080

    Article  MATH  Google Scholar 

  27. Nallaperumal K, Ravi S, Babu CNK, Selvakumar R, Fred AL, Seldev C, Vinsley S (2007) Skin detection using color pixel classification with application to face detection: a comparative study. In: International Conference on Computational Intelligence and Multimedia Applications, IEEE, vol 3, pp 436–441

  28. Nordstrøm MM, Larsen M, Sierakowski J, Stegmann MB (2004) The IMM face database - an annotated dataset of 240 face images. http://www2.imm.dtu.dk/pubdb/p.php?3160

  29. Open Source Computer Vision (OpenCV) Library. http://opencv.org. (Accessed Dec 2013)

  30. Rowley HA, Baluja S, Kanade T (1998) Rotation invariant neural network-based face detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE, pp 38–44

  31. Sabouri S, Razzazi F, Taimori A (2009) Using combining classifiers for accurate detection of natural faces in color static images. In: 14th Iranian Annual Conf. CSICC

  32. Shewchuk JR, 1997 Delaunay refinement mesh generation. PhD thesis

  33. Shi J, Tomasi C (1994) Good features to track. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’94), IEEE, pp 593–600

  34. Shin Y, Kim EY (2006) Welfare interface using multiple facial features tracking. In: AI 2006: Advances in Artificial Intelligence. Springer, pp 453–462

  35. Taimori A, Behrad A, Ghassemian H (2010) Automatic human face detection and tracking using cascaded classifiers and deformable meshes. MJEE 10(1): 126–109

    Google Scholar 

  36. Torr PHS (1995) Motion segmentation and outlier detection. University of Oxford UK, PhD thesis

    Google Scholar 

  37. Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154

    Article  Google Scholar 

  38. Wu T, Zou Y, Wang W (2008) Skin-color based particle filtering for human face tracking. In: IEEE Conference on Cybernetics and Intelligent Systems, IEEE, pp 728–733

  39. Xiong X, De la Torre F (2013) Supervised descent method and its applications to face alignment. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, pp 532–539

  40. Xu Z, Zhu M (2006) Color-based skin detection: survey and evaluation. In: 12th International Multi-Media Modelling Conference, IEEE, pp 10–pp

  41. Yang MH, Kriegman DJ, Ahuja N (2002) Detecting faces in images: a survey. IEEE T Pattern Anal 24(1):34–58

    Article  Google Scholar 

  42. Zhao GQ, Chen L, Chen GC (2005) A simple 3d face tracking method based on depth information. In: International Conference on Machine Learning and Cybernetics, IEEE, vol 8, pp 5022–5027

  43. Zhou M, Liang L, Sun J, Wang Y (2010) Aam based face tracking with temporal matching and face segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, pp 701–708

  44. Zhu Y, Fujimura K (2003) Driver face tracking using gaussian mixture model (gmm). In: IEEE Intelligent Vehicles Symposium, IEEE, pp 587–592

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran

    Ali Taimori

  2. Electrical and Electronic Engineering Department, Faculty of Engineering, Shahed University, Tehran, Iran

    Alireza Behrad

Authors
  1. Ali Taimori
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alireza Behrad
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alireza Behrad.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Taimori, A., Behrad, A. A new deformable mesh model for face tracking using edge based features and novel sets of energy functions. Multimed Tools Appl 74, 10735–10759 (2015). https://doi.org/10.1007/s11042-014-2204-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-2204-y

Keywords

Search

Navigation