Skip to main content
SpringerLink
Log in

Facial Expression Recognition Adopting Combined Geometric and Texture-Based Features

  • Conference paper
  • First Online:
Artificial Intelligence Algorithms and Applications (ISICA 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1205))

Included in the following conference series:

  • 2310 Accesses

Abstract

In recent facial expression recognition competitions, top approaches were using either geometric relationships that best captured facial dynamics or an accurate registration technique to develop texture features. These two methods capture two different types of facial information that is similar to how the human visual system divides information when perceiving faces. This paper discusses a framework of a fully automated comprehensive facial expression detection and classification. We study the capture of facial expressions through geometric and texture-based features, and demonstrate that a simple concatenation of these features can lead to significant improvement in facial expression classification. Each type of expression has individual differences in the commonality of facial expression features due to differences in appearance and other factors. The geometric feature tends to emphasize the facial parts that are changed from the neutral and peak expressions, which can represent the common features of the expression, thus reducing the influence of the difference in appearance and effectively eliminating the individual differences. Meanwhile, the consolidation of gradient-level normalized cross correlation and Gabor wavelet is utilized to present the texture features. We perform experiments using the well-known extended Cohn-Kanade (CK+) database, compared to the other state of the art algorithms, the proposed method achieved provide better performance with an average accuracy of 95.3%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Deepthi, S., Archana, G.S., JagathyRaj, V.P.: Facial expression recognition using artificial neural networks. OSR J. Comput. Eng. (IOSR-JCE) 8(4), 01–06 (2013). ISSN 2278–0661, ISBN2278-8727

    Google Scholar 

  2. Punitha, A., Geetha, M.K.: HMM based real time facial expression recognition. Int. J. Emerg. Technol. Adv. Eng. 3(1), 180–185 (2013)

    Google Scholar 

  3. Zhang, B., Liu, G.: Facial expression recognition using LBP and LPQ based on Gabor wavelet transform based on Gabor face image. In: IEEE International Conference on Computer and Communications (2016)

    Google Scholar 

  4. Owusu, E., Zhan, Y., Mao, Q.R.: An SVM-AdaBoost facial expression recognition system. Appl. Intell. 40(3), 536–545 (2014)

    Article  Google Scholar 

  5. Shah, S.K., Khanna, V.: Facial expression recognition for color images using Gabor, log Gabor filters and PCA. Int. J. Comput. Appl. 113(4), 42–46 (2015)

    Google Scholar 

  6. Lajevardi, S.M., Hussain, Z.M.: Feature extraction for facial expression recognition based on hybrid face regions. Adv. Electr. Comput. Eng. 9(3), 63–67 (2009)

    Article  Google Scholar 

  7. ELLaban, H.A., Ewees, A.A., Elsaeed, A.E.: A real-time system for facial expression recognition using support vector machines and k-nearest neighbor classifier. Int. J. Comput. Appl. 159(8), 0975–8887 (2017)

    Google Scholar 

  8. Lee, J.J, Uddin, M.Z., Kim, T.S.: Spatiotemporal human facial expression recognition using fisher independent component analysis and hidden markov model. In: 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS 2008, pp 2546–2549. IEEE (2008)

    Google Scholar 

  9. Sumathi, C.P., Santhanam, T., Mahadevi, M.: Automatic facial expression analysis a survey. IEEE Int. J. Comput. Sci. Eng. Surv. 3(6), 47 (2012)

    Article  Google Scholar 

  10. Shojaeilangari, S., Yau, W.Y., Nandakumar, K., Li, J., Teoh, E.K.: Robust representation and recognition of facial emotions using extreme sparse learning. IEEE Trans. Image Process. 24, 2140–2152 (2015)

    Article  MathSciNet  Google Scholar 

  11. Littlewort, G., et al.: The computer expression recognition toolbox (CERT). In: IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011) (2011). https://doi.org/10.1109/fg.2011.5771414

  12. Razuri, J.G., Sundgren, D., Rahmani, R., Cardenas, A.M.: Automatic emotion recognition through facial expression analysis in merged images based on an artificial neural network. In: 12th Mexican International Conference on Artificial Intelligence, pp. 85–96 (2013). https://doi.org/10.1109/micai.2013.16

  13. Kar, A., Mukerjee, A.: Facial expression classification using visual cues and language. In: IIT (2011). http://www.cs.berkeley.edu/*akar/se367/project/report.pdf

    Google Scholar 

  14. Viola, P.A., Jones, M.J.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001. IEEE (2001)

    Google Scholar 

  15. Jabid, T., Kabir, M.H., Chae, O.: Robust facial expression recognition based on local directional pattern. ETRI J. 32(5), 784–794 (2010)

    Article  Google Scholar 

  16. Milborrow, S., Nicolls, F.: Locating facial features with an extended active shape model. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5305, pp. 504–513. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88693-8_37

    Chapter  Google Scholar 

  17. Milborrow, S., Nicolls, F.: Active shape models with SIFT descriptors and MARS. In: Proceedings of the International Conference on Computer Vision Theory and Applications (VISAPP), vol. 2, pp. 380–387 (2014)

    Google Scholar 

  18. Li, L., Leung, M.K.H.: Integrating intensity and texture differences for robust change detection. IEEE Trans. Image Process. 2002, 105–112 (2002)

    Google Scholar 

  19. Faisal, A., Emam, H.: Automated facial expression recognition using gradient-based ternary texture patterns. Chin. J. Eng. 2013, 8 (2013). Article ID 831747

    Google Scholar 

  20. Donato, G., Bartlett, M.S., Hager, J.C., Ekman, P., Sejnowski, T.J.: Classifying facial actions. IEEE Trans. Pattern Anal. Mach. Intell. 21(10), 974–989 (1999)

    Article  Google Scholar 

  21. Liu, C., Wechsler, H.: Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition. IEEE Trans. Image Process. 11(4), 467–476 (2002)

    Article  Google Scholar 

  22. Zhu, J.X., Su, G.D., Li, Y.E.: Facial expression recognition based on Gabor feature and Adaboost. J. Optoelectron. Laser 17, 993–998 (2006)

    Google Scholar 

  23. Turk, M.A., Pentland, A.P.: Face recognition using eigenfaces. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 586–591 (1991)

    Google Scholar 

  24. Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs fisherfaces: recognition using class specific linear projection. IEEE. Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)

    Article  Google Scholar 

  25. Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 27(2), 1–27 (2011)

    Article  Google Scholar 

  26. Vapnik, V.: Statistical Learning Theory. Wiley, New York (1998)

    MATH  Google Scholar 

  27. Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade dataset (CK+): a complete facial expression dataset for action unit and emotion-specified expression. In: Proceedings 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 94–101 (2010)

    Google Scholar 

Download references

Acknowledgments

This work was supported by the Scientific Research Fund of Sichuan Provincial Education Department under Grant No. 18ZB0013, the Science and Technology Project of Dujiangyan under Grant No. 2018FW01.

Author information

Authors and Affiliations

  1. Chengdu Neusoft University, Dujiangyan, Chengdu, China

    Yujiao Gong & Yongbo Yuan

Authors
  1. Yujiao Gong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yongbo Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yujiao Gong .

Editor information

Editors and Affiliations

  1. South China Agricultural University, Guangzhou, China

    Kangshun Li

  2. Jiangxi University of Science and Technology, Ganzhou, China

    Wei Li

  3. South China Agricultural University, Guangzhou, China

    Hui Wang

  4. The University of Aizu, Aizu-Wakamatsu, Fukushima, Japan

    Yong Liu

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gong, Y., Yuan, Y. (2020). Facial Expression Recognition Adopting Combined Geometric and Texture-Based Features. In: Li, K., Li, W., Wang, H., Liu, Y. (eds) Artificial Intelligence Algorithms and Applications. ISICA 2019. Communications in Computer and Information Science, vol 1205. Springer, Singapore. https://doi.org/10.1007/978-981-15-5577-0_36

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-5577-0_36

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-5576-3

  • Online ISBN: 978-981-15-5577-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation