Emotion Recognition in Facial Image Sequences Using a Combination of AAM with FACS and DBN
If we want to recognize the human’s emotion via the face-to-face interaction, first of all, we need to extract the emotional features from the facial image and recognize the emotional states. . Our facial emotional feature detection and extracting based on Active Appearance Models (AAM) with Ekman’s Facial Action Coding System (FACS). Our approach to facial emotion recognition lies in the dynamic and probabilistic framework based on Dynamic Bayesian Network (DBN). The active appearance model (AAM) is a well-known method that can represent a non-rigid object, such as face, facial expression. In this paper, our approach to facial feature extraction lies in the proposed feature extraction method based on combining AAM with Facial Action Units of Facial Action Coding System (FACS) for automatically modeling and extracting the facial emotional features. Also, we use the Dynamic Bayesian Networks (DBNs) for modeling and understanding the temporal phases of facial expressions in image sequences.
KeywordsFacial Emotion Recognition Facial Feature Extraction Active Appearance Model Facial Action Coding System Dynamic Bayesian Network
Unable to display preview. Download preview PDF.
- 2.Ekman, P., Friesen, W.V.: The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica 1, 49–98Google Scholar
- 3.DataFace Site: Facial Expressions, Emotions Expressions, Nonverbal Communication, Physiognomy, http://www.face-and-emotion.com
- 4.Padgett, C., Cottrell, G.: Representing Face Images for Emotion Classification. In: Mozer, M., Jordan, M., Petsche, T. (eds.) Advances in Neural Information Processing Systems, vol. 9 (1997)Google Scholar
- 6.Yi-Bin, S., Jian-Ming, Z., Jian-Hua, T., Geng-Tao, Z.: An improved facial feature localization method based on ASM. In: 7th International Conference on Computer-Aided Industrial Design and Conceptual Design, CAIDCD 2006 (2006)Google Scholar
- 7.Kobayasho, S., Hashimoto, S.: Automated feature extraction of face image and its applications. In: International Workshop on Robot and Human Communication, pp. 164–169Google Scholar
- 10.Stegmann, M.B.: Analysis and Segmentation of Face Images using Point Annotations and Linear Subspace Techinques. informatics and mathematical modelling Lingby, Denmark: Tech. Univ. Denmark, IMM Tech. Rep. IMM-REP-2002-22 (August 2002)Google Scholar
- 11.Ekman, Friesen, W.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)Google Scholar
- 12.Ekman, P., Friesen, W.V.: http://www.cs.cmu.edu/afs/cs/project/face/www/facs.htm
- 13.Mita, T., Kaneko, T., Hori, O.: Joint Haar-like Features for Face Detection. In: Proceedings of the 10th IEEE International Conference on Computer Vision, October 17-21, vol. 2, pp. 1619–16261 (2005)Google Scholar