Integrated Expression-Invariant Face Recognition with Constrained Optical Flow

  • Chao-Kuei Hsieh
  • Shang-Hong Lai
  • Yung-Chang Chen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5414)


Face recognition is one of the most intensively studied topics in computer vision and pattern recognition. A constrained optical flow algorithm, which combines the advantages of the unambiguous correspondence of feature point labeling and the flexible representation of optical flow computation, has been proposed in our pervious work for face recognition from expressional face images. In this paper, we propose an integrated face recognition system that is robust against facial expressions by combining information from the computed intra-person optical flow and the synthesized face image in a probabilistic framework. Our experimental results show that the proposed system improves the accuracy of face recognition from expressional face images.


Face recognition expression recognition constrained optical flow expression normalization 


  1. 1.
    Li, X., Mori, G., Zhang, H.: Expression-invariant face recognition with expression classification. In: Proc. 3rd Canadian Conf. on Computer and Robot Vision (June 2006)Google Scholar
  2. 2.
    Martinez, A.M.: Recognizing expression variant faces from a single sample image per class. In: Proc. IEEE Conf. Computer Vision Pattern Recognition (June 2003)Google Scholar
  3. 3.
    Hsieh, C.-K., Lai, S.-H., Chen, Y.-C.: Expression-invariant face recognition with accurate optical flow. In: Ip, H.H.-S., Au, O.C., Leung, H., Sun, M.-T., Ma, W.-Y., Hu, S.-M. (eds.) PCM 2007. LNCS, vol. 4810, pp. 78–87. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  4. 4.
    Hsieh, C.-K., Lai, S.-H., Chen, Y.-C.: Expressional face image analysis with constrained optical flow. In: Proc. of ICME, Hannover, Germany, June 23-26 (2008)Google Scholar
  5. 5.
    Teng, C.-H., Lai, S.-H., Chen, Y.-S., Hsu, W.-H.: Accurate optical flow computation under non-uniform brightness variations. In: Computer Vision and Image Understanding, vol. 97, pp. 315–346 (2005)Google Scholar
  6. 6.
    Yin, L., Wei, X., Sun, Y., Wang, J., Rosato, M.J.: A 3D facial expression database for facial behavior research. In: Proc. Intern. Conf. on Automatic Face and Gesture Recognition, pp. 211–216 (April 2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Chao-Kuei Hsieh
    • 1
  • Shang-Hong Lai
    • 2
  • Yung-Chang Chen
    • 1
  1. 1.Department of Electrical EngineeringNational Tsing Hua UniversityTaiwan
  2. 2.Department of Computer ScienceNational Tsing Hua UniversityTaiwan

Personalised recommendations