Skip to main content

Facial Expression Recognition by Considering Nonuniform Local Binary Patterns

  • Conference paper
  • First Online:
Emerging Research in Computing, Information, Communication and Applications

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 906))

  • 857 Accesses

Abstract

Recognizing a face with an expression has paying attention due to its well-known applications in a broad range of fields like data-driven animation, human–machine interaction, robotics, and driver fatigue detection. People can vary significantly their facial expression; hence, facial expression recognition is not an easy problem. This paper presents a significant contribution for facial expression recognition by deriving a new set of stable transitions of local binary pattern by selecting the significant nonuniform local binary patterns. The proposed patterns are stable, because of the transitions from two or more consecutive ones to two or more consecutive zeros. For better recognition rate, the new set of patterns are combined with uniform patterns of local binary pattern. A distance function is used on proposed texture features for effective facial expression recognition. Preprocessing method is also used to get rid of the effects of illumination changes in facial expression by preserving the significant appearance details that are needed for facial expression recognition. The investigational analysis was done on the popular JAFFE facial expression database and has shown good performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Guo, G., & Dyer, C. (2005). Learning from examples in the small sample case: Face expression recognition. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 35(3), 477–488.

    Article  Google Scholar 

  2. Zhang, Q., Liu, Z., Quo, G., Terzopoulos, D., & Shum, H. Y. (2006). Geometry-driven photorealistic facial expression synthesis. IEEE Transactions on Visualization and Computer Graphics, 12(1), 48–60.

    Article  Google Scholar 

  3. Feng, X. Facial expression recognition based on local binary patterns and coarse-to-fine classification. In Proceedings of the Fourth International Conference on Computer and Information Technology (CIT’04).

    Google Scholar 

  4. Shan, C., Gong, S., & McOwan, P. W. (2009). Facial expression recognition based on local binary patterns: A comprehensive study. Image and Vision Computing, 27, 803–816.

    Article  Google Scholar 

  5. Huang, D., Shan, C., Ardabilian, M., Wang, Y., & Chen, L. (2011). Local binary patterns and its application to facial image analysis: A survey. IEEE Transaction on Systems, Man and Cybernetics-Part C: Applications and Reviews, 41(6), 765–781.

    Article  Google Scholar 

  6. Ye, J. F., Zhan, Y. Z., & Song, S. L. (2004). Facial expression features extraction based on Gabor wavelet transformation. IEEE International Conference on System, Man and Cybernetics, 3, 2215–2219.

    Google Scholar 

  7. Kaur, M., Vashisht, R., & Neeru, N. (2010). Recognition of facial expressions with principal component analysis and singular value decomposition. International Journal of Computer Applications, 9(12), 36–40.

    Article  Google Scholar 

  8. Feng, X., Pietikainen, M., & Hadid, A. (2005). Facial expression recognition with local binary patterns and linear programming. Pattern Recognition and Image Analysis, 15(2), 546–548.

    Google Scholar 

  9. Fellenz, W., Taylor, J., Tsapatsoulis, N., & Kollias, S. (1999). Comparing template-based, feature based and supervised classification of facial expression from static images. Computational Intelligence and Applications, 19, 9.

    Google Scholar 

  10. Ahonen, T., Hadid, A., & Pietikinen, M. (2004). Face recognition with local binary patterns. In ECCV (pp. 469–481).

    Google Scholar 

  11. Ojala, T., Pietikainen, M., & Maenpaa, T. (2002). Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(7), 971–987.

    Article  Google Scholar 

  12. Liao, S., Fan, W., Chung, A. C. S., & Yeung, D.-Y. (2006). Facial expression recognition using advanced local binary patterns, Tsallis entropies and global appearance features. In ICIP (pp. 665–668).

    Google Scholar 

  13. Tan X., & Triggs B. (2007). Enhanced local texture feature sets for face recognition under difficult lighting conditions. In Proceedings of the 2007 IEEE International Workshop on Analysis and Modeling of Faces and Gestures (AMFG’07), Rio de Janeiro, Brazil (pp. 168–182).

    Google Scholar 

  14. Lyons, M. J., Akamatsu, S., Kamachi, M., Gyoba, J., & Budynek, J. (1998). The Japanese female facial expression (JAFFE) database. http://www.kasrl.org/jaffe.html.

  15. Vijaya Kumar, V., Srinivasa Reddy, K., & Krishna, V. V. (2015). Face recognition using prominent LBP model. International Journal of Applied Engineering Research (IJAER), 10(2), 4373–4384.

    Google Scholar 

  16. Fathi, A., & Naghsh-Nilchi, A. R. (2012). Noise tolerant local binary pattern operator for efficient texture analysis. Pattern Recognition Letters, 33(9), 1093–1100.

    Article  Google Scholar 

  17. Liu, L., Zhao, L., Long, Y., Kuang, G., & Fieguth, P. (2012). Extended local binary patterns for texture classification. Image and Vision Computing, 30(2), 86–99.

    Article  Google Scholar 

  18. Nguyen, H. V., Bai, L., Shen, L. (2009). Local gabor binary pattern whitened pca: A novel approach for face recognition from single image per person. In Advances in biometrics (pp. 269–278). Berlin, Heidelberg, Springer.

    Chapter  Google Scholar 

  19. Srinivasa Reddy, K., Venkata Krishna, V., & Vijaya Kumar, V. (2016). A method for facial recognition based on local features. International Journal of Mathematics and Computation (IJMC), 27(03), 98–112.

    MathSciNet  Google Scholar 

  20. Lowe, D. G. (2004). Distinctive image features from scale-invariant key points. International Journal of Computer Vision, 60(2), 91–110.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to K. Srinivasa Reddy .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Srinivasa Reddy, K., Sunil Reddy, E., Baswanth, N. (2019). Facial Expression Recognition by Considering Nonuniform Local Binary Patterns. In: Shetty, N., Patnaik, L., Nagaraj, H., Hamsavath, P., Nalini, N. (eds) Emerging Research in Computing, Information, Communication and Applications. Advances in Intelligent Systems and Computing, vol 906. Springer, Singapore. https://doi.org/10.1007/978-981-13-6001-5_55

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-6001-5_55

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-6000-8

  • Online ISBN: 978-981-13-6001-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics