Multimedia Tools and Applications

, Volume 76, Issue 5, pp 7365–7379 | Cite as

Expression recognition method based on evidence theory and local texture

  • Wencheng Wang
  • Faliang Chang
  • Yunlong Liu
  • Xiaojin Wu


To the question of feature selection and multi-feature fusion in facial expression recognition, a novel fusion model is proposed in this paper based on evidence theory and local feature operator. First, the facial image is divided into several regions with significant recognition features, and the Local Binary Pattern (LBP) textural features of the regions are extracted. Then, the LBP histograms in the local regions are connected into a single histogram list, and Chi-square distance is used as the similarity measure to establish the guidelines for evidence synthesis. Finally, the Dempster-Shafer evidence inference theory (D-S evidence theory) is adopted to accomplish the feature vector fusion of all components and the class judgment of facial expression is performed. Experiment shows that the method is simple and effective, which has a high recognition rate and can improve the performance of the facial expression recognition system to some extent.


Expression recognition Evidence theory Local binary pattern Texture feature 


  1. 1.
    Chowdhury MIH, Alam FI (2014) A probabilistic approach to support Self-Organizing Map (SOM) driven facial expression recognition. IEEE 2014 17th International Conference on Computer and Information Technology, pp. 210–216Google Scholar
  2. 2.
    Dang LT, Cooper EW, Kamei K (2014) Development of facial expression recognition for training video customer service representatives. 2014 I.E. International Conference on Fuzzy Systems, pp. 1297–1303Google Scholar
  3. 3.
    Dempster AP (1967) Upper and lower probabilities induced by a multivalued mapping. Ann Math Stat 325–339Google Scholar
  4. 4.
    Dosodia P, Poonia A, Gupta SK, Agrwal SL (2015) New Gabor-DCT feature extraction technique for facial expression recognition. 2015 Fifth International Conference on Communication Systems and Network Technologies, pp. 546–549Google Scholar
  5. 5.
    Essa I, Pentland A (1995) Facial expression recognition using a dynamic model and motion energy. Proceedings of the Fifth International Conference on Computer Vision, pp. 360–367Google Scholar
  6. 6.
    Fu X, Wei W (2009) Facial expression recognition based on advanced local binary pattern histogram projection. Pattern Recognit Artif Intell 22(1):123–128Google Scholar
  7. 7.
    Gueorguieva N, Georgiev G, Valova I (2003) Facial expression recognition using feed forward neural networks. Proceedings of the International Conference on Artificial Intelligence, pp. 285–291Google Scholar
  8. 8.
    Guo G, Dyer CR (2003) Learning from examples in the small sample case: face expression recognition. IEEE Trans Syst Man Cybern 35(3):477–488CrossRefGoogle Scholar
  9. 9.
    He J, Cai J, Fang L, He Zhong Z (2015) A method of facial expression recognition based on LBP fusion of key expressions areas. IEEE 27th Chinese Control and Decision Conference (CCDC), pp. 4200–4204Google Scholar
  10. 10.
    Jin H, Gao W (2003) Analysis and application of the facial expression motions based on Eigen-flow. J Softw 14(12):2098–2105MathSciNetMATHGoogle Scholar
  11. 11.
    Kim D, Jung S, Chung M (2008) Extension of cascaded simple feature based face detection to facial expression recognition. Pattern Recogn Lett 29(11):1621–1631CrossRefGoogle Scholar
  12. 12.
    Kwak N (2008) Feature extraction for classification problems and its application to face recognition. Pattern Recogn 41(5):1701–1717MATHCrossRefGoogle Scholar
  13. 13.
    Lee CS, Elgammal A (2005) Facial expression analysis using nonlinear decomposable generative models. Proceeding of the 2nd IEEE International Workshop on Analysis and Modeling of Faces and Gestures. Beijing, China, pp. 17–31Google Scholar
  14. 14.
    Lyons M, Budynek J, Akamatsu S (1999) Automatic classification of single facial images. IEEE Trans Pattern Anal Mach Intell 21(12):1357–1362CrossRefGoogle Scholar
  15. 15.
    Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987MATHCrossRefGoogle Scholar
  16. 16.
    Ou J, Bai X, Pei Y, Ma L, Liu W (2010) Automatic facial expression recognition using Gabor filter and expression analysis. IEEE International Conference on Computer Modeling and Simulation, pp. 215–218Google Scholar
  17. 17.
    Suk M, Prabhakaran B (2015) real-time facial expression recognition on smartphones. IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1054–1059Google Scholar
  18. 18.
    Sun N, Ji Z, Zou C, Zha L (2007) Image local feature extraction method based on two-dimensional partial least square and its application in facial expression recognition. J Image Graph 12(5):848–853Google Scholar
  19. 19.
    VenkataRamiReddy C, Kishore KK, Bhattacharyya D, Kim TH (2014) Multi-feature fusion based facial expression classification using DLBP and DCT. Int J Softw Eng Appl 8(9):55–68Google Scholar
  20. 20.
    Wang Y, Ai H, Wu B (2004) Real time facial expression recognition with adaboost. IEEE 17th International Conference on Pattern Recognition, Cambridge UK, pp. 926–929Google Scholar
  21. 21.
    Xiao R, Zhao Q, Zhang D, Shi P (2011) Facial expression recognition on multiple manifolds. Pattern Recogn 44(1):107–116MATHCrossRefGoogle Scholar
  22. 22.
    Yang S, Luo H, Hu X (2009) A combination rule of evidence theory based on similarity of focal elements. Pattern Recogn Artif Intell 22(2):169–175Google Scholar
  23. 23.
    Ying Z, Tang J, Li J, Zhang Y (2008) Support vector discriminant analysis and its application to facial expression recognition. ACTA Electron Sinic 36(4):725–730Google Scholar
  24. 24.
    Zhang Y, Ji Q (2005) Active and dynamic information fusion for facial expression understanding from image dequences. IEEE Trans Pattern Anal Mach Intell 27(5):699–714CrossRefGoogle Scholar
  25. 25.
    Zhao G, Pietikäinen M (2007) Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans Pattern Anal Mach Intell 29(6):915–928CrossRefGoogle Scholar
  26. 26.
    Zhao XM, Zhang SQ (2011) Facial expression recognition based on local binary patterns and kernel discriminant isomap. Sensors 11(12):9573–9588MathSciNetCrossRefGoogle Scholar
  27. 27.
    Zhao X, Zhang S (2012) Facial expression recognition using local binary patterns and discriminant kernel locally linear embedding. EURASIP Journal on Advances in Signal Processing, pp. 1–9Google Scholar
  28. 28.
    Zheng W, Zhou X, Zou C (2006) Facial expression recognition using Kernel Canonical Correlation Analysis (KCCA). IEEE Trans Neural Netw 17(1):233–238CrossRefGoogle Scholar
  29. 29.
    Zheng N, Qi L, Guan L (2015) Multiple-manifolds discriminant analysis for facial expression recognition from local patches set. Lect Notes Artif Intell 8869:26–33Google Scholar
  30. 30.
    Zhou X, Zheng W, Zou C, Zhao L (2009) Facial expression recognition based on feature fusion and fuzzy kernel discriminant analysis. J Image Graph 14(8):1615–1620Google Scholar
  31. 31.
    Zhu M, Luo D (2009) Face and expression recognition method by combing 2DFLD with LPP. Pattern Recogn Artif Intell 22(1):60–63Google Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Wencheng Wang
    • 1
    • 2
  • Faliang Chang
    • 2
  • Yunlong Liu
    • 1
  • Xiaojin Wu
    • 1
  1. 1.Department of Information and Control EngineeringWeifang UniversityWeifangChina
  2. 2.College of Control Science and EngineeringShandong UniversityJinanChina

Personalised recommendations