Skip to main content

Emotion Recognition from Facial Expression Using Neural Networks

  • Chapter
Human-Computer Systems Interaction

Part of the book series: Advances in Intelligent and Soft Computing ((AINSC,volume 60))

Abstract

This research aims at developing “Humanoid Robots” that can carry out intellectual conversation with human beings. The first step of our research is to recognize human emotions by a computer using neural network. In this paper all six universally recognized principal emotions namely angry, disgust, fear, happy, sad and surprise along with neutral one are recognized. Various neural networks such as Support Vector Machine (SVM), Multilayer Perceptron (MLP), Principal Component Analysis (PCA), and Generalized Feed Forward Neural Network (GFFNN) are employed and their performance is compared. 100% recognition accuracy is achieved on training data set (seen examples) and test data set (unseen examples).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Meharabian, A.: Communication without words. Psychology Today 2(4), 53–56 (1968)

    Google Scholar 

  2. Picard, R.W.: Affective computing. MIT Press, Cambridge (1997)

    Google Scholar 

  3. Picard, R.W.: Toward agents that recognize emotion. In: Proc. IMAGINA Conference, Monaco, pp. 153–155 (1998)

    Google Scholar 

  4. Li, H., Roivainen, P., Forcheimer, R.: 3D motion estimation in model-based facial image coding. IEEE Trans. Pattern Analysis and Machine Intelligence 15(6), 545–555 (1993)

    Article  Google Scholar 

  5. Mase, K.: Recognition of facial expression from optical flow. IEICE Trans. E 74, 3474–3483 (1991)

    Google Scholar 

  6. Terzopoulos, D., Waters, K.: Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Trans. Pattern Analysis and Machine Intelligence 15(6), 569–579 (1993)

    Article  Google Scholar 

  7. Yaccob, Y., Devis, L.: Recognizing human facial expression from long image sequences using optical flow. IEEE Trans. Pattern Analysis and Machine Intelligence 18(6), 636–642 (1996)

    Article  Google Scholar 

  8. Bassili, J.N.: Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. J. Personality and Social Psych. 37, 2049–2059 (1979)

    Article  Google Scholar 

  9. Essa, I.A., Pentland, A.P.: Coding, analysis, interpretation and recognition of facial expressions. IEEE Trans. on Pattern Analysis and Machine Intelligence 13(7), 715–729 (1997)

    Google Scholar 

  10. Essa, I.R.: Analysis, interpretation and synthesis of facial expressions by IR. PhD dissertation, Massachusetts Institute of Technology, Cambridge, MA (1995)

    Google Scholar 

  11. Gianluca, D., Bartlett, M.S., Hager, J.C., Ekman, P., Sejnowski, T.J.: Classifying facial actions. IEEE Trans. Pattern Analysis and Machine Intelligence 21(10), 974–989 (1999)

    Article  Google Scholar 

  12. Essa, I.R., Pentland, A.P.: Coding, analysis, interpretation and recognition of facial expressions. IEEE Trans. Pattern Analysis and Machine Intelligence 19(7), 757–763 (1997)

    Article  Google Scholar 

  13. Rosenblum, M., Yacoob, Y., Davis, L.S.: Human expression recognition from motion using a radial basis function network architecture. IEEE Trans. Neural Networks 7(5), 1121–1138 (1996)

    Article  Google Scholar 

  14. Mase, K., Pentland, A.: Recognition of facial expression from optical flow. IEICE Trans. E (74), 408–410 (1991)

    Google Scholar 

  15. Lanitis, A., Taylor, C.J., Cootes, T.F.: Automatic interpretation and coding of face images using flexible models. IEEE Trans. Pattern Analysis and Machine Intelligence 19(7), 743–756 (1997)

    Article  Google Scholar 

  16. Matsugu, M., Mori, K., Mitari, Y., Kaneda, Y.: Subject independent facial expression recognition with robust face detection using a convolution neural network. Neural Network 16(5-6), 555–559 (2003)

    Article  Google Scholar 

  17. Gargesha, M., Kuchi, P.: Facial expression recognition using artificial neural networks (2002), http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.4.8462 (accessed May 11, 2009)

  18. Yeasin, M., Bullot, B., Sharma, R.: Recognition of facial expressions and measurement of levels of interest from video. IEEE Trans. on Multimedia 8(3), 1312–1324 (2006)

    Article  Google Scholar 

  19. Black, M., Yacoob, Y.: Recognizing facial expressions in image sequences using local parameterized models of image motion. Intern. J. Computer Vision 25(1), 23–48 (1997)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Kharat, G.U., Dudul, S.V. (2009). Emotion Recognition from Facial Expression Using Neural Networks. In: Hippe, Z.S., Kulikowski, J.L. (eds) Human-Computer Systems Interaction. Advances in Intelligent and Soft Computing, vol 60. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03202-8_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-03202-8_17

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-03201-1

  • Online ISBN: 978-3-642-03202-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics