A Novel Shape Registration Framework and Its Application to 3D Face Recognition in the Presence of Expressions

  • Rachid Fahmi
  • Aly A. Farag
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5359)


This paper introduces a new global-to-local shape registration technique and shows its potential in solving the problem of 3D face recognition in the presence of expressions. The proposed registration technique is a two-step technique that operates in an implicit higher dimensional space where the powerful distance transform is used as the embedding function. First, a new dissimilarity measure is introduced to recover the transformation that globally aligns the two input shapes. This new measure can deal efficiently with rigid, similarity and affine motions. Second, the local coordinate transformation between the two globally aligned shapes is explicitly estimated by minimizing a new energy functional consisting of three terms. The first term is a discrepancy measure between the two shape representations. The second term penalizes the deviation of the distance map representation of the globally warped source shape from a signed distance function, while the local displacement field is being updated. The last term is a regularization term that enforces the smoothness of the recovered deformations. This leads to a set of coupled equations that are simultaneously minimized through a gradient descent scheme. The overall potential of the proposed framework is demonstrated through various 2D/3D experimental results. As an application, we address the 3D face recognition problem in presence of facial expressions.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Guo, H., Rangarajan, A., Joshi, S., Younes, L.: Non-rigid registration of shapes via diffeomorphic point-matching. In: IEEE ISBI 2004, pp. 924–927 (2004)Google Scholar
  2. 2.
    Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE TPAMI 24, 509–522 (2002)CrossRefGoogle Scholar
  3. 3.
    Huang, X., Paragios, N., Metaxas, D.N.: Shape registration in implicit spaces using information theory and free form deformations. IEEE TPAMI 28, 1303–1318 (2006)CrossRefGoogle Scholar
  4. 4.
    AbdEl-Munim, H., Farag, A.A.: Shape representation and registration using vector distance functions. In: Proc. of IEEE CVPR 2007, pp. 1–8 (2007)Google Scholar
  5. 5.
    Lee, S., Wolberd, G., Shin, S.: Scattered data interpolationwith multilevel bsplines. IEEE Trans. on Vis. Comp. Graph. 3, 228–244 (1997)CrossRefGoogle Scholar
  6. 6.
    Papatheodorou, T., Rueckert, D.: 3d face recognition. In: Delac, K., Grgic, M. (eds.) Face Recognition. I-Tech Education and Publishing, Vienna (2007)Google Scholar
  7. 7.
    Hutton, T.: Dense surface models of the human face. PhD thesis, University College London (2004)Google Scholar
  8. 8.
    Pan, G., Wu, Z., Pan, Y.: Automatic 3d face verification from range data. In: Proc. of Acoustics, Speech, and Signal Processing (ICASSP 2003), pp. 193–196 (2003)Google Scholar
  9. 9.
    Russ, T.D., Koch, M.W., Little, C.Q.: A 2d range hausdorff approach for 3d face recognition. In: Proc. of the IEEE CVPR 2005–Workshops, Washington, DC, USA, pp. 169–176 (2005)Google Scholar
  10. 10.
    Chang, K.J., Bowyer, K.W., Flynn, P.J.: Effects on facial expression in 3d face recognition. In: Proc. of SPIE Conf. on Biometric Tech. for Human Identification, pp. 132–143 (2005)Google Scholar
  11. 11.
    Besl, P.J., McKay, N.D.: A method for registration of 3-d shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 239–256 (1992)CrossRefGoogle Scholar
  12. 12.
    Wang, Y., Pan, G., Wu, Z., Wang, Y.: 3d face recognition in the presence of expression: A guidance-based constraint deformation approach. In: Proc. of ACCV 2006, pp. 581–590 (2006)Google Scholar
  13. 13.
    Wang, Y., Pan, G., Wu, Z.: Exploring facial expression effects in 3d face recognition using partial ICP. In: Proc. of CVPR 2007 (2007)Google Scholar
  14. 14.
    Paragios, N., Rousson, M., Ramesh, V.: Non-rigid registration using distance functions. Comput. Vis. Image Underst. 89, 142–165 (2003)CrossRefzbMATHGoogle Scholar
  15. 15.
    Valadez, G.H.: Variational methods for multimodal image matching. Ph.D., Thesis at Université de Nice - Sophia Antipolis (2002)Google Scholar
  16. 16.
    Sethian, J.: Level Sets Methods and Fast Marching Methods, 2nd edn. Cambridge University Press, Cambridge (1999)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Rachid Fahmi
    • 1
  • Aly A. Farag
    • 1
  1. 1.Computer Vision and Image Processing Laboratory (CVIP Lab.)University of LouisvilleLouisvilleUSA

Personalised recommendations