Analysis of Local Binary Pattern for Facial Expression Recognition Using Patch Local Binary Pattern on Extended Cohn Kanade Database

  • Halina HassanEmail author
  • Shahrel Azmin SuandiEmail author
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 547)


Deriving an effective facial representation from original face images is a vital step for successful facial expression recognition. In this paper, we explore the effect of representing the information in facial expression recognition using local patch local binary pattern (LBP). The processed information with accurate representation of different expressions can discriminate and improve the overall facial expression recognition accuracy. The objective of this paper is to analyze the effect of using local region patch to represent facial features with local binary pattern as the feature extraction method. In our experiment, first facial landmark is being detected using cascade linear regression, followed by alignment and normalization. The LBP feature extraction is being performed on the holistic image, followed by patch of mouth and eyes. At the final stage support vector machine (SVM) has been used as a classifier to examine the recognition rate. The results are being validated using the extended Cohn-Kanade database. From the analysis, it is found that using local region LBP can significantly reduce the number of features to be fed into SVM. Hence the processing time is improved.


Facial expression recognition Local binary pattern Feature extraction Support vector machine 



The authors thank the Universiti Sains Malaysia for the material resources and expertise support in preparing this research proposal. This research is fully supported by research university individual grant from Universiti Sains Malaysia, Grant No. 304/PELECT/6316115.


  1. 1.
    Kumari, J., Rajesh, R., Pooja, K.: Facial expression recognition: A survey. Procedia Comput. Sci. 58, 486–491 (2015)CrossRefGoogle Scholar
  2. 2.
    Shan, C., Gong, S., McOwan, P.W.: Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis. Comput. 27(6), 803–816 (2009)CrossRefGoogle Scholar
  3. 3.
    Hassan, H., Yaacob, S., Radman, A., Suandi, S.A.: Eye state detection for driver inattention based on Lucas Kanade optical flow algorithm. In: International Conference on Intelligent and Advanced System ICIAS 2016, no. IEEE Xplore (2017)Google Scholar
  4. 4.
    Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Inlligence 28(12), 2037–2041 (2006)CrossRefGoogle Scholar
  5. 5.
    Pumlumchiak, T., Sirion, V.: Facial expression recognition using local gabor filters and PCA plus LDA. In: 9th International Conference on Information Technology and Electrical Engineering, pp. 1–6 (2017)Google Scholar
  6. 6.
    Liu, Y., Li, Y., Ma, X., Song, R.: Facial expression recognition with fusion features extracted from salient facial areas. Sensors 17(4), 1–19 (2017)CrossRefGoogle Scholar
  7. 7.
    Zhang, S., Zhao, X., Lei, B.: Robust facial expression recognition via compressive sensing. Sensors 12(3), 3747–3761 (2012)CrossRefGoogle Scholar
  8. 8.
    Guarnera, M., Hichy, Z., Cascio, M.I., Carrubba, S.: Facial expressions and ability to recognize emotions from eyes or mouth in children. Eur. J. Psychol. 11(2), 183–196 (2015)CrossRefGoogle Scholar
  9. 9.
    Ghimire, D., Jeong, S., Lee, J., Park, S.H.: Facial expression recognition based on local region specific features and support vector machines. Multimed Tools Appl. 76, 7803–7821 (2017)CrossRefGoogle Scholar
  10. 10.
    Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade dataset (CK +): a complete dataset for action unit and emotion-specified expression. In: Computer Vision and Pattern Recognition Workshops, pp. 94–101 (2010)Google Scholar
  11. 11.
    Pumlumchiak, T.: Facial expression recognition using local gabor filters and PCA plus LDA. In: 2017 9th International Conference on Information Technology and Electrical Engineering, pp. 1–6, Oct 2017Google Scholar
  12. 12.
    Asthana, A., Zafeiriou, S., Cheng, S., Pantic, M.: Incremental face alignment in the wild. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1859–1866 (2014)Google Scholar
  13. 13.
    Zhao, X., Zhang, S.: Facial expression recognition based on local binary patterns and kernel discriminant isomap. Sensors 11(10), 9573–9588 (2011)CrossRefGoogle Scholar
  14. 14.
    Ojala, T., Pietikasinen, M., Harwood, D.: A comparative study of texture measure with classification based on feature distributions. Pattern Recognit. 29(l), 51–59 (1996)Google Scholar
  15. 15.
    Cigdem Turan, K.-M.L.: Region-based feature fusion for facial-expression recognition. In: International Conference on Image Processing, pp. 5966–5970 (2014)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Malaysian Spanish InstituteUniversiti Kuala LumpurKuala LumpurMalaysia
  2. 2.School of Electrical and Electronic EngineeringUniversiti Sains MalaysiaNibong TebalMalaysia

Personalised recommendations