Skip to main content

Facial Expression Recognition in Various Internal States Using Independent Component Analysis

  • Conference paper
Articulated Motion and Deformable Objects (AMDO 2006)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 4069))

Included in the following conference series:

  • 859 Accesses

Abstract

This paper presents a new approach method to recognize facial expressions in various internal states using independent component analysis (ICA). We developed a representation of facial expression images based on independent component analysis for feature extraction of facial expressions. This representation consists of two steps. In the first step, we present a representation based on principal component analysis (PCA) excluded the first 2 principal components to reflect well the changes in facial expressions. Second, ICA representation from this PCA representation was developed. Finally, classification of facial expressions in various internal states was created on two dimensional structure of emotion with pleasure/displeasure dimension and arousal/sleep dimension. The proposed algorithm demonstrates the ability to discriminate the changes of facial expressions in various internal states. This system is possible to use in cognitive processes, social interaction and behavioral investigations of emotion.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bartlett, M., Viola, P., Sejnowski, T., Larsen, J., Hager, J., Ekman, P.: Classfying Facial Action. In: Touretzky, D., et al. (eds.) Advances in Neural Information Processing Systems 8. MIT Press, Cambridge (1996)

    Google Scholar 

  2. Essa, I., Pentland, A.: Coding, analysis, interpretation, and recognition of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 757–763 (1997)

    Article  Google Scholar 

  3. Lien, J.: Automatic recognition of facial expressions using hidden Markov models and estimation of expression intensity. Ph.D. Thesis, Carnegie Mellon University (1998)

    Google Scholar 

  4. Oliver, N., Pentland, A., Berard, F.: LAFTER: a real-time face and lips tracker with facial expression recognition. Pattern Recognition 33, 1369–1382 (2000)

    Article  Google Scholar 

  5. Cohen, I., Sebe, N., Garg, A., Chen, L.S., Huang, T.S.: Facial expression recognition from video sequence. In: Proc. Int’l. Conf. Multimedia and Exp. (ICME), pp. 121–124 (2002)

    Google Scholar 

  6. Peter, J.L.: The emotion probe: Studies of motivation and attention. American Psychologist 50(5), 372–385 (1995)

    Article  Google Scholar 

  7. Russell, J.A.: Evidence of convergent validity on the dimension of affect. Journal of Personality and Social Psychology 30, 1152–1168 (1978)

    Article  Google Scholar 

  8. Donato, G., Bartlett, M., Hager, J., Ekman, P., Sejnowski, T.: Classifying facial actions. IEEE PAMI 21(10), 974–989 (1999)

    Google Scholar 

  9. Pantic, M., Rothkrantz, L.J.M.: Towards an Affect-Sensitive Multimodal Human Computer Interaction. Proc. Of IEEE 91, 1370–1390

    Google Scholar 

  10. Youngsuk, S., Youngjoon, A.: Facial expression recognition based on two dimensions with-out neutral expressions. In: Kishino, F., Kitamura, Y., Kato, H., Nagata, N. (eds.) ICEC 2005. LNCS, vol. 3711, pp. 215–222. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  11. Bartlett, M.: Face Image analysis by unsupervised learning. Kluwer Academic Publishers, Dordrecht (2001)

    MATH  Google Scholar 

  12. Comon, P.: Independent component analysis - a new concept? Signal processing 36, 287–314 (1994)

    Article  MATH  Google Scholar 

  13. Saebum, B., Jaehyun, H., Chansub, C.: Facial expression database for mapping facial expression onto internal state. In: 1997 Emotion Conference of Korea, pp. 215–219 (1997)

    Google Scholar 

  14. Osgood, C.E., May, W.H., Miron, M.S.: Cross-curtral universals of affective meaning. University of Illinoise Press, Urbana (1975)

    Google Scholar 

  15. Russell, J.A., Lewicka, M., Nitt, T.: A cross-cultural study of a circumplex model of affect. Journal of Personality and Social Psychology 57, 848–856 (1989)

    Article  Google Scholar 

  16. Younga, K., Jinkwan, K., Sukyung, P., Kyungja, O., Chansub, C.: The study of dimension of internal states through word analysis about emotion. Korean Journal of the Science of Emotion and Sensibility 1, 145–152 (1998)

    Google Scholar 

  17. Atick, J., Redlich, A.: What does the retina know about natural scenes? Neural Computation (4), 196–210 (1992)

    Article  Google Scholar 

  18. Olshasen, B., Field, D.: Natural image statistics and efficient coding. Network: computation in neural systems 7(2), 333–340 (1996)

    Article  Google Scholar 

  19. Bell, A., Sejnowski, T.: The independent components of natural scenes areedge filters. Vision Research 37(23), 3327–3338 (1997)

    Article  Google Scholar 

  20. Hyvarinen, A., Karhunen, J., Oja, E.: Independent component analysis. John Wiley & Sons, Inc., Chichester (2001)

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Shin, Ys. (2006). Facial Expression Recognition in Various Internal States Using Independent Component Analysis. In: Perales, F.J., Fisher, R.B. (eds) Articulated Motion and Deformable Objects. AMDO 2006. Lecture Notes in Computer Science, vol 4069. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11789239_30

Download citation

  • DOI: https://doi.org/10.1007/11789239_30

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-36031-5

  • Online ISBN: 978-3-540-36032-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics