Advertisement

Improvement and Estimation of Intensity of Facial Expression Recognition for Human-Computer Interaction

  • Kunal Chanda
  • Washef Ahmed
  • Soma Mitra
  • Debasis Mazumdar
Part of the Smart Innovation, Systems and Technologies book series (SIST, volume 27)

Abstract

With the ubiquity of new information technology and media, more effective and friendly methods for human computer interaction (HCI) are being developed. The first step for any intelligent HCI system is face detection and one of the most friendly HCI systems is facial expression recognition. Although Facial Expression Recognition for HCI introduces the frontiers of vision-based interfaces for intelligent human computer interaction, very little has been explored for capturing one or more expressions from mixed expressions which are a mixture of two closely related expressions. This paper presents the idea of improving the recognition accuracy of one or more of the six prototypic expressions namely happiness, surprise, fear, disgust, sadness and anger from the mixture of two facial expressions. For this purpose a motion gradient based optical flow for muscle movement is computed between frames of a given video sequence. The computed optical flow is further used to generate feature vector as the signature of six basic prototypic expressions. Decision Tree generated rule base is used for clustering the feature vectors obtained in the video sequence and the result of clustering is used for recognition of expressions. Manhattan distance metric is used which captures the relative intensity of expressions for a given face present in a frame. Based on the score of intensity of each expression, degree of presence of each of the six basic facial expressions has been determined. With the introduction of Component Based Analysis which is basically computing the feature vectors on the proposed regions of interest on a face, considerable improvement has been noticed regarding recognition of one or more expressions. The results have been validated against human judgement.

Keywords

Human Computer Interaction Facial Expression Analysis mixed expressions Component Based Analysis gradient based optical flow decision tree quantification of score human psycho-visual judgement 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Darwin, C.: The expression of Emotions in Man and Animals. Univ. Chicago Press (1872)Google Scholar
  2. 2.
    Ekman, P.: Facial expressions and emotion. Amer. Psychol. 48, 384–392 (1978); Consulting Psychologists Press(1978)Google Scholar
  3. 3.
    Ekman, P., Friesen, W.V.: Facial Action Coding System (FACS): Manual. Pal Alto, Calf.Google Scholar
  4. 4.
    Ambadar, Z., Schooler, J., Cohn, J.F.: Deciphering the enigmatic face, the importance of facial dynamics in interpreting subtle facial expression. Psychological Science (2005)Google Scholar
  5. 5.
    Horn, B.K.P., Schunck, B.G.: Determing optical flow. Artificial Intelligence 17 (1981)Google Scholar
  6. 6.
    Dunn, J.C.: A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters. Journal of Cybernetics 3, 32–57 (1973)CrossRefMATHMathSciNetGoogle Scholar
  7. 7.
    Gupta, G.K.: Introduction to data mining with case studies. Prentice Hall of India Private Limited (2006)Google Scholar
  8. 8.
    Reilly, J., Ghent, J., McDonald, J.F.: Investigating the dynamics of facial expression. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Remagnino, P., Nefian, A., Meenakshisundaram, G., Pascucci, V., Zara, J., Molineros, J., Theisel, H., Malzbender, T. (eds.) ISVC 2006. LNCS, vol. 4292, pp. 334–343. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  9. 9.
    Bezdak, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York (1981)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Kunal Chanda
    • 1
  • Washef Ahmed
    • 1
  • Soma Mitra
    • 1
  • Debasis Mazumdar
    • 1
  1. 1.Centre for Development of Advanced ComputingKolkataIndia

Personalised recommendations