Muscular Movement Model Based Automatic 3D Facial Expression Recognition

  • Qingkai Zhen
  • Di Huang
  • Yunhong Wang
  • Liming Chen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8935)


Facial expression is the most important channel for human nonverbal communication. This paper presents a novel and effective approach to automatic 3D Facial Expression Recognition, FER based on the Muscular Movement Model (MMM). In contrast to most of existing methods, MMM deals with such an issue in the viewpoint of anatomy. It first automatically segments the input face by localizing the corresponding points around each muscular region of the reference face using Iterative Closest Normal Pattern (ICNP). A set of shape features of multiple differential quantities, including coordinates, normals and shape index values, are then extracted to describe the geometry deformation of each segmented region. Therefore, MMM tends to combine both the advantages of the model based techniques as well as the feature based ones. Meanwhile, we analyze the importance of these muscular areas, and a score level fusion strategy which optimizes the weights of the muscular areas by using a Genetic Algorithm (GA) is proposed in the learning step. The muscular areas with their optimal weights are finally combined to predict the expression label. The experiments are carried out on the BU-3DFE database, and the results clearly demonstrate the effectiveness of the proposed method.


3D Facial Expression Recognition Muscular Movement Model 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Berretti, S., Bimbo, A.D., Pala, P., Amor, B.B., Daoudi, M.: A set of selected sift features for 3D facial expression recognition. In: ICPR (2010)Google Scholar
  2. 2.
    Gong, B., Wang, Y., Liu, J., Tang, X.: Automatic facial expression recognition on a single 3D face by exploring shape deformation. ACM MM (2009)Google Scholar
  3. 3.
    Hao, T., Huang, T.S.: 3D facial expression recognition based on automatically selected features. In: CVPRW (2008)Google Scholar
  4. 4.
    Klassen, E., Srivastava, A.: Geodesics between 3D closed curves using path-straightening. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 95–106. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  5. 5.
    Lemaire, P., Amor, B.B., Ardabilian, M., Chen, L., Daoudi, M.: Fully automatic 3D facial expression recognition using a region-based approach. J-HGBU (2011)Google Scholar
  6. 6.
    Li, H., Jean-Marie, M., Chen, L.: 3D facial expression recognition based on histograms of surface differential quantities. ACIVS (2011)Google Scholar
  7. 7.
    Mohammadzade, H., Hatzinakos, D.: Iterative closest normal point for 3D face recognition. IEEE TPAMI (2013)Google Scholar
  8. 8.
    Mpiperis, I., Malassiotis, S., Strintzis, M.G.: Bilinear models for 3D face and facial expression recognition. IEEE TIFS (2008)Google Scholar
  9. 9.
    Nair, P., Cavallaro, A.: 3D face detection landmark localization and registration using a point distribution model. IEEE TMM (2009)Google Scholar
  10. 10.
    Soyel, H., Demirel, H.: Facial expression recognition using 3D facial feature distances. ICIAR (2007)Google Scholar
  11. 11.
    Szeptycki, P., Ardabilian, M., Chen, L.: A coarse-to-fine curvature analysis-based rotation invariant 3D face landmarking. In: BTAS (2009)Google Scholar
  12. 12.
    Fang, T., Zhao, X., Ocegueda, O., Shah, S.K., Kakadiaris, I.A.: 3D facial expression recognition: A perspective on promises and challenges. In: FG (2011)Google Scholar
  13. 13.
    Wang, J., Yin, L., Wei, X., Sun, Y.: 3D facial expression recognition based on primitive surface feature distribution. In: CVPR (2006)Google Scholar
  14. 14.
    Yin, L., Wei, X., Longo, P., Bhuvanesh, A.: Analyzing facial expressions using intensity-variant 3D data for human computer interaction. In: ICPR (2006)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Qingkai Zhen
    • 1
  • Di Huang
    • 1
  • Yunhong Wang
    • 1
  • Liming Chen
    • 2
  1. 1.IRIP Lab, School of Computer Science and EngineeringBeihang Univ.BeijingChina
  2. 2.LIRIS UMR5205Ecole Centrale de LyonLyonFrance

Personalised recommendations