Statistical Models of Shape and Texture for Face Recognition

  • Timothy F. Cootes
  • David Cristinacce
  • Vladimir Petrović
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4170)


Human faces are an example of a class of objects in which each example exhibits significant variation in shape and appearance, but which is composed of a fixed number of sub-parts which have a similar configuration in every case. For such objects we can define landmark points on each example which imply a correspondence between different examples. We can then build statistical models of the shape by considering the relative positions of landmarks, and can model the pattern of intensities across the object by warping them into a common reference frame. Such combined models of shape and appearance have been found to be powerful tools for image interpretation. They are generative models, capable of synthesizing new examples similar to those in the training set. The formulation of such models is described, and their application to face location and recognition investigated. Particular attention is paid to methods of matching such models to new images in a multi-stage process.


Face Recognition Face Image Facial Feature Training Image Appearance Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1407, pp. 484–498. Springer, Heidelberg (1998)CrossRefGoogle Scholar
  2. 2.
    Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(6), 681–685 (2001)CrossRefGoogle Scholar
  3. 3.
    Cootes, T.F., Wheeler, G.V., Walker, K.N., Taylor, C.J.: View-based active appearance models. Image and Vision Computing 20, 657–664 (2002)CrossRefGoogle Scholar
  4. 4.
    Cootes, T.F., Taylor, C.J., Cooper, D., Graham, J.: Active shape models - their training and application. Computer Vision and Image Understanding 61(1), 38–59 (1995)CrossRefGoogle Scholar
  5. 5.
    Costen, N., Cootes, T.F., Taylor, C.J.: Compensating for ensemble-specificity effects when building facial models. Image and Vision Computing 20, 673–682 (2002)CrossRefGoogle Scholar
  6. 6.
    Cristinacce, D., Cootes, T.: Facial feature detection using ADABOOST with shape constraints. In: 14th British Machine Vision Conference, vol.1, pp. 231–240 (2003)Google Scholar
  7. 7.
    Cristinacce, D., Cootes, T.: A comparison of shape constrained facial feature detectors. In: 6th International Conference on Automatic Face and Gesture Recognition 2004, Seoul, Korea, pp. 375–380 (2004)Google Scholar
  8. 8.
    Cristinacce, D., Cootes, T., Scott, I.: A multi-stage approach to facial feature detection. In: 15th British Machine Vision Conference, vol. 1, pp. 277–286 (2004)Google Scholar
  9. 9.
    Dryden, I., Mardia, K.V.: The Statistical Analysis of Shape. Wiley, London (1998)Google Scholar
  10. 10.
    Edwards, G., Taylor, C.J., Cootes, T.F.: Interpreting face images using active appearance models. In: 3rd International Conference on Automatic Face and Gesture Recognition 1998, Japan, pp. 300–305 (1998)Google Scholar
  11. 11.
    Freund, Y., Schapire, R.: A decision-theoretic generalization of on-line learning and an application to boosting. In: Vitányi, P.M.B. (ed.) EuroCOLT 1995. LNCS, vol. 904. Springer, Heidelberg (1995)Google Scholar
  12. 12.
    Goodall, C.: Procrustes methods in the statistical analysis of shape. Journal of the Royal Statistical Society B 53(2), 285–339 (1991)MATHMathSciNetGoogle Scholar
  13. 13.
    Harris, C., Stephens, M.: A combined edge and corner detector. In: Alvey Vision Conference, pp. 147–151 (1988)Google Scholar
  14. 14.
    Jesorsky, O., Kirchberg, K.J., Frischholz, R.W.: Robust face detection using the hausdorff distance. In: Bigun, J., Smeraldi, F. (eds.) AVBPA 2001. LNCS, vol. 2091, p. 90. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  15. 15.
    Kang, H., Cootes, T., Taylor, C.: A comparison of face verification algorithms using appearance models. In: Rosin, P.L., Marshall, D. (eds.) 13th British Machine Vison Conference, vol.2, pp. 477–486. BMVA Press (September 2002)Google Scholar
  16. 16.
    Kirby, M., Sirovich, L.: Application of the Karhumen-Loeve procedure for the characterization of human faces. IEEE Transactions on Pattern Analysis and Machine Intelligence 12(1), 103–108 (1990)CrossRefGoogle Scholar
  17. 17.
    Messer, K., Matas, J., Kittler, J., Luettin, J., Maitre, G.: XM2VTSdb: The extended m2vts database. In: Proc. 2nd Conf. on Audio and Video-based Biometric Personal Verification, pp. 72–77. Springer, Heidelberg (1999)Google Scholar
  18. 18.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Computer Vision and Pattern Recognition Conference 2001, vol.1, pp. 511–518 (2001)Google Scholar
  19. 19.
    Scott, I.M., Cootes, T.F., Taylor, C.J.: Improving appearance model matching using local image structure. In: Taylor, C.J., Noble, J.A. (eds.) IPMI 2003. LNCS, vol. 2732, pp. 258–269. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  20. 20.
    Turk, M., Pentland, A.: Eigenfaces for recognition. Journal of Cognitive Neuroscience 3(1), 71–86 (1991)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Timothy F. Cootes
    • 1
  • David Cristinacce
    • 1
  • Vladimir Petrović
    • 1
  1. 1.Imaging Science and Biomedical EngineeringUniversity of ManchesterUK

Personalised recommendations