Facial Expression Recognition in Various Internal States Using Independent Component Analysis

  • Young-suk Shin
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4069)


This paper presents a new approach method to recognize facial expressions in various internal states using independent component analysis (ICA). We developed a representation of facial expression images based on independent component analysis for feature extraction of facial expressions. This representation consists of two steps. In the first step, we present a representation based on principal component analysis (PCA) excluded the first 2 principal components to reflect well the changes in facial expressions. Second, ICA representation from this PCA representation was developed. Finally, classification of facial expressions in various internal states was created on two dimensional structure of emotion with pleasure/displeasure dimension and arousal/sleep dimension. The proposed algorithm demonstrates the ability to discriminate the changes of facial expressions in various internal states. This system is possible to use in cognitive processes, social interaction and behavioral investigations of emotion.


Facial Expression Internal State Independent Component Analysis Face Image Independent Component Analysis 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bartlett, M., Viola, P., Sejnowski, T., Larsen, J., Hager, J., Ekman, P.: Classfying Facial Action. In: Touretzky, D., et al. (eds.) Advances in Neural Information Processing Systems 8. MIT Press, Cambridge (1996)Google Scholar
  2. 2.
    Essa, I., Pentland, A.: Coding, analysis, interpretation, and recognition of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 757–763 (1997)CrossRefGoogle Scholar
  3. 3.
    Lien, J.: Automatic recognition of facial expressions using hidden Markov models and estimation of expression intensity. Ph.D. Thesis, Carnegie Mellon University (1998) Google Scholar
  4. 4.
    Oliver, N., Pentland, A., Berard, F.: LAFTER: a real-time face and lips tracker with facial expression recognition. Pattern Recognition 33, 1369–1382 (2000)CrossRefGoogle Scholar
  5. 5.
    Cohen, I., Sebe, N., Garg, A., Chen, L.S., Huang, T.S.: Facial expression recognition from video sequence. In: Proc. Int’l. Conf. Multimedia and Exp. (ICME), pp. 121–124 (2002)Google Scholar
  6. 6.
    Peter, J.L.: The emotion probe: Studies of motivation and attention. American Psychologist 50(5), 372–385 (1995)CrossRefGoogle Scholar
  7. 7.
    Russell, J.A.: Evidence of convergent validity on the dimension of affect. Journal of Personality and Social Psychology 30, 1152–1168 (1978)CrossRefGoogle Scholar
  8. 8.
    Donato, G., Bartlett, M., Hager, J., Ekman, P., Sejnowski, T.: Classifying facial actions. IEEE PAMI 21(10), 974–989 (1999)Google Scholar
  9. 9.
    Pantic, M., Rothkrantz, L.J.M.: Towards an Affect-Sensitive Multimodal Human Computer Interaction. Proc. Of IEEE 91, 1370–1390Google Scholar
  10. 10.
    Youngsuk, S., Youngjoon, A.: Facial expression recognition based on two dimensions with-out neutral expressions. In: Kishino, F., Kitamura, Y., Kato, H., Nagata, N. (eds.) ICEC 2005. LNCS, vol. 3711, pp. 215–222. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  11. 11.
    Bartlett, M.: Face Image analysis by unsupervised learning. Kluwer Academic Publishers, Dordrecht (2001)MATHGoogle Scholar
  12. 12.
    Comon, P.: Independent component analysis - a new concept? Signal processing 36, 287–314 (1994)MATHCrossRefGoogle Scholar
  13. 13.
    Saebum, B., Jaehyun, H., Chansub, C.: Facial expression database for mapping facial expression onto internal state. In: 1997 Emotion Conference of Korea, pp. 215–219 (1997)Google Scholar
  14. 14.
    Osgood, C.E., May, W.H., Miron, M.S.: Cross-curtral universals of affective meaning. University of Illinoise Press, Urbana (1975)Google Scholar
  15. 15.
    Russell, J.A., Lewicka, M., Nitt, T.: A cross-cultural study of a circumplex model of affect. Journal of Personality and Social Psychology 57, 848–856 (1989)CrossRefGoogle Scholar
  16. 16.
    Younga, K., Jinkwan, K., Sukyung, P., Kyungja, O., Chansub, C.: The study of dimension of internal states through word analysis about emotion. Korean Journal of the Science of Emotion and Sensibility 1, 145–152 (1998)Google Scholar
  17. 17.
    Atick, J., Redlich, A.: What does the retina know about natural scenes? Neural Computation (4), 196–210 (1992)CrossRefGoogle Scholar
  18. 18.
    Olshasen, B., Field, D.: Natural image statistics and efficient coding. Network: computation in neural systems 7(2), 333–340 (1996)CrossRefGoogle Scholar
  19. 19.
    Bell, A., Sejnowski, T.: The independent components of natural scenes areedge filters. Vision Research 37(23), 3327–3338 (1997)CrossRefGoogle Scholar
  20. 20.
    Hyvarinen, A., Karhunen, J., Oja, E.: Independent component analysis. John Wiley & Sons, Inc., Chichester (2001)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Young-suk Shin
    • 1
  1. 1.Department of Information and telecommunication EngineeringChosun UniversityDong-gu, GwangjuKorea

Personalised recommendations