Facial Expression Recognition Based on the Belief Theory: Comparison with Different Classifiers

  • Z. Hammal
  • L. Couvreur
  • A. Caplier
  • M. Rombaut
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3617)


This paper presents a system for classifying facial expressions based on a data fusion process relying on the Belief Theory (BeT). Four expressions are considered: joy, surprise, disgust as well as neutral. The proposed system is able to take into account intrinsic doubt about emotion in the recognition process and to handle the fact that each person has his/her own maximal intensity of displaying a particular facial expression. To demonstrate the suitability of our approach for facial expression classification, we compare it with two other standard approaches: the Bayesian Theory (BaT) and the Hidden Markov Models (HMM). The three classification systems use characteristic distances measuring the deformations of facial skeletons. These skeletons result from a contour segmentation of facial permanent features (mouth, eyes and eyebrows). The performances of the classification systems are tested on the Hammal-Caplier database [1] and it is shown that the BeT classifier outperforms both the BaT and HMM classifiers for the considered application.


Facial Expression Hide Markov Model Characteristic Distance Facial Expression Recognition Bayesian Classifier 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
  2. 2.
    Cohn, J., Zlochower, A.J., Lien, J.J., Kanade, T.: Feature-point tracking by optical flow discriminates subtle differences in facial expression. IEEE ICFGR (3), 396–401 (1998)Google Scholar
  3. 3.
    Pantic, M., Rothkrantz, L.J.M.: Expert system for automatic analysis of facial expressions. IVC 118, 881 (2000)Google Scholar
  4. 4.
    Cohen, I., Cozman, F.G., Sebe, N., Cirelo, M.C., Huang, T.S.: Semi supervised Learning of Classifiers: Theory, Algorithms and their Application to Human-Computer Interaction“. IEEE Trans. On PAMI 26, 1553–1567 (2004)Google Scholar
  5. 5.
    Eveno, N., Caplier, A., Coulon, P.Y.: Automatic and Accurate Lip Tracking. IEEE Trans. On CSVT 14, 706–715 (2004)Google Scholar
  6. 6.
    Hammal, Z., Caplier, A.: Eye and Eyebrow Parametric Models for Automatic Segmentation. In: IEEE SSIAI, Lake Tahoe, Nevada (2004)Google Scholar
  7. 7.
    Smets, P.H.: Data Fusion in the Transferable Belief Model. In: Proc. ISIF, France, pp. 21–33 (2000)Google Scholar
  8. 8.
    Malciu, M., Preteux, F.: MPEG-4 Compliant Tracking of Facial Features in Video Sequences. In: Proc. EUROIMAGE, ICAV3D, Greece, pp. 108–111 (2001)Google Scholar
  9. 9.
    Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77(2), 257–286 (1989)CrossRefGoogle Scholar
  10. 10.
    Moon, T.K., Stirling, W.C.: Mathematical Methods and Algorithms for Signal Processing. Prentice-Hall, Englewood Cliffs (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Z. Hammal
    • 1
  • L. Couvreur
    • 2
  • A. Caplier
    • 1
  • M. Rombaut
    • 1
  1. 1.Laboratory of images and signals LISGrenobleFrance
  2. 2.Signal Processing LaboratoryFaculté Polytechnique de MonsMonsBelgium

Personalised recommendations