Skip to main content

Facial Expression Recognition with Regional Features Using Local Binary Patterns

  • Conference paper
Computer Analysis of Images and Patterns (CAIP 2013)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8047))

Included in the following conference series:

Abstract

This paper presents a simple yet efficient and completely automatic approach to recognize six fundamental facial expressions using Local Binary Patterns (LBPs) texture features. A system is proposed that can automatically locate four important facial regions from which the uniform LBPs features are extracted and concatenated to form a 236 dimensional enhanced feature vector to be used for six fundamental expressions recognition. The features are trained using three widely used classifiers: Naive bayes, Radial Basis Function Network (RBFN) and three layered Multi-layer Perceptron (MLP3). The notable feature of the proposed method is the use of few preferred regions of the face to extract the LBPs features as opposed to the use of entire face. The experimental results obtained from MMI database show proficiency of the proposed features extraction method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Mehrabian, A.: Nonverbal communication. Aldine (2007)

    Google Scholar 

  2. Sun, Y., Yin, L.: Facial expression recognition based on 3D dynamic range model sequences. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part II. LNCS, vol. 5303, pp. 58–71. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  3. Shan, C., Gong, S., McOwan, P.: Facial expression recognition based on local binary patterns: A comprehensive study. Image and Vision Computing 27, 803–816 (2009)

    Article  Google Scholar 

  4. Tsalakanidou, F., Malassiotis, S.: Real-time 2d+ 3d facial action and expression recognition. Pattern Recognition 43, 1763–1775 (2010)

    Article  Google Scholar 

  5. Moridis, C., Economides, A.: Affective learning: Empathetic agents with emotional facial and tone of voice expressions. IEEE Transactions on Affective Computing 3, 260–272 (2012)

    Article  Google Scholar 

  6. Moore, S., Bowden, R.: Local binary patterns for multi-view facial expression recognition. Computer Vision and Image Understanding 115, 541–558 (2011)

    Article  Google Scholar 

  7. Chan, C.-H., Kittler, J., Messer, K.: Multi-scale local binary pattern histograms for face recognition. In: Lee, S.-W., Li, S.Z. (eds.) ICB 2007. LNCS, vol. 4642, pp. 809–818. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  8. Ahonen, T., Hadid, A., Pietikäinen, M.: Face recognition with local binary patterns. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 469–481. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  9. Zhang, Z., Zhang, Z.: Feature-based facial expression recognition: Sensitivity analysis and experiments with a multilayer perceptron. International Journal of Pattern Recognition and Artificial Intelligence 13, 893–911 (1999)

    Article  Google Scholar 

  10. Rosenblum, M., Yacoob, Y., Davis, L.: Human expression recognition from motion using a radial basis function network architecture. IEEE Transactions on Neural Networks 7, 1121–1138 (1996)

    Article  Google Scholar 

  11. Zhao, G., Pietikainen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 915–928 (2007)

    Article  Google Scholar 

  12. Viola, P., Jones, M.: Robust real-time object detection. International Journal of Computer Vision 57, 137–154 (2002)

    Article  Google Scholar 

  13. Majumder, A., Behera, L., Venkatesh, K.S.: Automatic and Robust Detection of Facial Features in Frontal Face Images. In: Proceedings of the 13th International Conference on Modelling and Simulation. IEEE (2011)

    Google Scholar 

  14. Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recognition 29, 51–59 (1996)

    Article  Google Scholar 

  15. Pantic, M., Valstar, M.F., Rademaker, R., Maat, L.: Web-based database for facial expression analysis. In: Proceedings of IEEE Int’l Conf. Multimedia and Expo, ICME 2005, Amsterdam, The Netherlands, pp. 317–321 (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Majumder, A., Behera, L., Subramanian, V.K. (2013). Facial Expression Recognition with Regional Features Using Local Binary Patterns. In: Wilson, R., Hancock, E., Bors, A., Smith, W. (eds) Computer Analysis of Images and Patterns. CAIP 2013. Lecture Notes in Computer Science, vol 8047. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40261-6_67

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-40261-6_67

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-40260-9

  • Online ISBN: 978-3-642-40261-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics