Comparing a Transferable Belief Model Capable of Recognizing Facial Expressions with the Latest Human Data
Despite significant amount of research on automatic classification of facial expressions, recognizing a facial expression remains a complex task to be achieved by a computer vision system. Our approach is based on a close look at the mechanisms of the human visual system, the best automatic facial expression recognition system yet. The proposed model is made for the classification of the six basic facial expressions plus Neutral on static frames based on the permanent facial features deformations using the Transferable Belief Model. The aim of the proposed work is to understand how the model behaves in the same experimental conditions as the human observer, to compare their results and to identify the missing informations so as to enhance the model performances. To do this we have given our TBM based model the ability to deal with partially occluded stimuli and have compared the behavior of this model with that of humans in a recent experiment, in which human participants had to classify the studied expressions that were randomly sampled using Gaussian apertures. Simulations show first the suitability of the TBM to deal with partially occluded facial parts and its ability to optimize the available information to take the best possible decision. Second they show the similarities of the human and model observers performances. Finally, we reveal important differences between the use of facial information in the human and model observers, which open promising perspectives for future developments of automatic systems.
KeywordsFacial Feature Behavior Facial Expressions Classification Transferable Belief Model Bubbles
Unable to display preview. Download preview PDF.
- 1.Darwin, C.: The expression of the emotions in man and animals. London, Murray (1872)Google Scholar
- 2.Ekman, P., Friesen, W.V., Ellsworth, P.: Emotion in the human face. Pergamon Press, New York (1972)Google Scholar
- 3.Izard, C.: The face of emotion. Appleton-Century-Crofts New York (1971)Google Scholar
- 5.Gao, Y., Leung, M., Hui, S., Tananda, M.: Facial expression recognition from line-based caricatures. IEEE Transaction on System, Man and Cybernetics - PART A: System and Humans 33(3) (2003)Google Scholar
- 7.Cohen, I., Cozman, F., Sebe, N., Cirelo, M., Huang, T.: Learning bayesian network classifiers for facial expression recognition using both labeled and unlabeled data. Proc. IEEE Computer Vision and Pattern Recognition (2003)Google Scholar
- 8.Hammal, Z., Couvreur, L., Caplier, A., Rombaut, M.: Facial expressions classification: A new approach based on transferable belief model. International Journal of Approximate Reasoning (2007), doi: 10.1016/j.ijar.2007.02.003Google Scholar
- 11.Smets, P.: Data fusion in the transferable belief model. In: Proc. of International Conference on Information Fusion, Paris, France, pp. 21–33 (2000)Google Scholar