Skip to main content

Analysis of Local Binary Pattern for Facial Expression Recognition Using Patch Local Binary Pattern on Extended Cohn Kanade Database

Part of the Lecture Notes in Electrical Engineering book series (LNEE,volume 547)

Abstract

Deriving an effective facial representation from original face images is a vital step for successful facial expression recognition. In this paper, we explore the effect of representing the information in facial expression recognition using local patch local binary pattern (LBP). The processed information with accurate representation of different expressions can discriminate and improve the overall facial expression recognition accuracy. The objective of this paper is to analyze the effect of using local region patch to represent facial features with local binary pattern as the feature extraction method. In our experiment, first facial landmark is being detected using cascade linear regression, followed by alignment and normalization. The LBP feature extraction is being performed on the holistic image, followed by patch of mouth and eyes. At the final stage support vector machine (SVM) has been used as a classifier to examine the recognition rate. The results are being validated using the extended Cohn-Kanade database. From the analysis, it is found that using local region LBP can significantly reduce the number of features to be fed into SVM. Hence the processing time is improved.

Keywords

  • Facial expression recognition
  • Local binary pattern
  • Feature extraction
  • Support vector machine

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-981-13-6447-1_80
  • Chapter length: 7 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   189.00
Price excludes VAT (USA)
  • ISBN: 978-981-13-6447-1
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   249.99
Price excludes VAT (USA)
Hardcover Book
USD   349.99
Price excludes VAT (USA)
Fig. 1
Fig. 2
Fig. 3

References

  1. Kumari, J., Rajesh, R., Pooja, K.: Facial expression recognition: A survey. Procedia Comput. Sci. 58, 486–491 (2015)

    CrossRef  Google Scholar 

  2. Shan, C., Gong, S., McOwan, P.W.: Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis. Comput. 27(6), 803–816 (2009)

    CrossRef  Google Scholar 

  3. Hassan, H., Yaacob, S., Radman, A., Suandi, S.A.: Eye state detection for driver inattention based on Lucas Kanade optical flow algorithm. In: International Conference on Intelligent and Advanced System ICIAS 2016, no. IEEE Xplore (2017)

    Google Scholar 

  4. Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Inlligence 28(12), 2037–2041 (2006)

    CrossRef  Google Scholar 

  5. Pumlumchiak, T., Sirion, V.: Facial expression recognition using local gabor filters and PCA plus LDA. In: 9th International Conference on Information Technology and Electrical Engineering, pp. 1–6 (2017)

    Google Scholar 

  6. Liu, Y., Li, Y., Ma, X., Song, R.: Facial expression recognition with fusion features extracted from salient facial areas. Sensors 17(4), 1–19 (2017)

    CrossRef  Google Scholar 

  7. Zhang, S., Zhao, X., Lei, B.: Robust facial expression recognition via compressive sensing. Sensors 12(3), 3747–3761 (2012)

    CrossRef  Google Scholar 

  8. Guarnera, M., Hichy, Z., Cascio, M.I., Carrubba, S.: Facial expressions and ability to recognize emotions from eyes or mouth in children. Eur. J. Psychol. 11(2), 183–196 (2015)

    CrossRef  Google Scholar 

  9. Ghimire, D., Jeong, S., Lee, J., Park, S.H.: Facial expression recognition based on local region specific features and support vector machines. Multimed Tools Appl. 76, 7803–7821 (2017)

    CrossRef  Google Scholar 

  10. Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade dataset (CK +): a complete dataset for action unit and emotion-specified expression. In: Computer Vision and Pattern Recognition Workshops, pp. 94–101 (2010)

    Google Scholar 

  11. Pumlumchiak, T.: Facial expression recognition using local gabor filters and PCA plus LDA. In: 2017 9th International Conference on Information Technology and Electrical Engineering, pp. 1–6, Oct 2017

    Google Scholar 

  12. Asthana, A., Zafeiriou, S., Cheng, S., Pantic, M.: Incremental face alignment in the wild. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1859–1866 (2014)

    Google Scholar 

  13. Zhao, X., Zhang, S.: Facial expression recognition based on local binary patterns and kernel discriminant isomap. Sensors 11(10), 9573–9588 (2011)

    CrossRef  Google Scholar 

  14. Ojala, T., Pietikasinen, M., Harwood, D.: A comparative study of texture measure with classification based on feature distributions. Pattern Recognit. 29(l), 51–59 (1996)

    Google Scholar 

  15. Cigdem Turan, K.-M.L.: Region-based feature fusion for facial-expression recognition. In: International Conference on Image Processing, pp. 5966–5970 (2014)

    Google Scholar 

Download references

Acknowledgements

The authors thank the Universiti Sains Malaysia for the material resources and expertise support in preparing this research proposal. This research is fully supported by research university individual grant from Universiti Sains Malaysia, Grant No. 304/PELECT/6316115.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Halina Hassan or Shahrel Azmin Suandi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Hassan, H., Suandi, S.A. (2019). Analysis of Local Binary Pattern for Facial Expression Recognition Using Patch Local Binary Pattern on Extended Cohn Kanade Database. In: Zawawi, M., Teoh, S., Abdullah, N., Mohd Sazali, M. (eds) 10th International Conference on Robotics, Vision, Signal Processing and Power Applications. Lecture Notes in Electrical Engineering, vol 547. Springer, Singapore. https://doi.org/10.1007/978-981-13-6447-1_80

Download citation