Inexact Graph Matching for Facial Feature Segmentation and Recognition in Video Sequences: Results on Face Tracking

  • Ana Beatriz V. Graciano
  • Roberto M. CesarJr.
  • Isabelle Bloch
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2905)


This paper presents a method for the segmentation and recognition of facial features and face tracking in digital video sequences based on inexact graph matching. It extends a previous approach proposed for static images to video sequences by incorporating the temporal aspect that is inherent to such sequences. Facial features are represented by attributed relational graphs, in which vertices correspond to different feature regions and edges to relations between them. A reference model is used and the search for an optimal homomorphism between its corresponding graph and that of the current frame leads to the recognition.


Video Sequence Facial Feature Model Image Graph Match Relational Graph 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Colliot, O., Tuzikov, A.V., Cesar Jr., R.M., Bloch, I.: Approximate reflectional symmetries of fuzzy objects with an application in model-based object recognition. In: Fuzzy Sets and Systems (2003) (in press)Google Scholar
  2. 2.
    Fontaine, D., Ramaux, N.: An approach by graphs for the recognition of temporal scenarios. IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics 28(3), 387–403 (1998)CrossRefGoogle Scholar
  3. 3.
    Cesar Jr., R.M., Bengoetxea, E., Bloch, I.: Inexact graph matching using stochastic optimization techniques for facial feature recognition. In: 16th International Conference on Pattern Recognition, August 2002, vol. 2, pp. 465–468 (2002)Google Scholar
  4. 4.
    Cesar Jr., R.M., Bloch, I.: First results on facial feature segmentation and recognition using graph homomorphisms. In: Proc. VI Simpósio Ibero-Americano de Reconhecimento de Padrões, Florianópolis, Brazil, pp. 95–99 (2001)Google Scholar
  5. 5.
    Cesar Jr., R.M., da, L., Costa, F.: Shape Analysis and Classification – Theory and Practice, 1st edn. CRC Press, Boca Raton (2001)Google Scholar
  6. 6.
    Kruger, V., Sommer, G.: Affine real-time face tracking using a wavelet network. In: Proc. of ICVV 1999 Workshop Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, Corfu, Greece, pp. 141–148 (1999)Google Scholar
  7. 7.
    Perchant, A., Bloch, I.: Fuzzy morphisms between graphs. Fuzzy Sets and Systems 128(2), 149–168 (2002)zbMATHCrossRefMathSciNetGoogle Scholar
  8. 8.
    Shah, M., Jain, R. (eds.): Motion-Based Recognition. Computational Imaging and Vision. Kluwer Academic Publishers, Dordrecht (1997)zbMATHGoogle Scholar
  9. 9.
    Shams, L.B., Brady, M.J., Schaal, S.: Graph matching vs mutual information maximization for object detection. Neural Networks 14, 345–354 (2001)CrossRefGoogle Scholar
  10. 10.
    Wilson, R.C., Hancock, E.R.: A Bayesian compatibility model for graph matching. Pattern Recognition Letters 17(3), 263–276 (1996)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Ana Beatriz V. Graciano
    • 1
  • Roberto M. CesarJr.
    • 1
  • Isabelle Bloch
    • 2
  1. 1.Department of Computer Science, IMEUniversity of São PauloSão PauloBrazil
  2. 2.Signal and Image Processing DepartmentCNRS UMR 5141 LTCI, École Nationale Supérieure des TélécommunicationsParisFrance

Personalised recommendations