Pose Invariant Face Recognition Method Using Stereo Vision

  • Jacek Komorowski
  • Przemyslaw Rokita
Conference paper
Part of the Advances in Intelligent and Soft Computing book series (AINSC, volume 95)


The paper presents a method to decrease dependency of image-based (appearance-based) face recognition solutions, such as Eigenfaces method, on a head orientation. Using information of a human head shape, recovered by stereo vision technique, a normalized face image (en face view) is synthesized. The normalized image is then processed by an image-based recognition subsystem. To effectively deal with large head rotations, where large area of the face is invisible due to occlusion, Eigenfaces recognition method is extended to operate on half-face images. Presented technique is verified experimentally to prove that it can be used to increase performance of image-based face recognition methods in applications where head pose of the subject is not controlled.


Face Recognition Face Image Stereo Vision Head Orientation Virtual Camera 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Blanz, W., Vetter, T.: Face Recognition Based on Fitting a 3D Morphable Model. IEEE Transactions on Pattern Analysis and Machine Intelligence 25(9), 1063–1074 (2003)CrossRefGoogle Scholar
  2. 2.
    Fehn, C.: Depth-Image Based Rendering (DIBR), Compression and Transmission for a New Approach on 3D-TV. In: Stereoscopic Displays and Virtual Reality Systems XI, Proceedings of the SPIE, vol. 5291, pp. 93–104 (2004)Google Scholar
  3. 3.
    Hirschmuller, H.: Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR 2005, vol. 2, pp. 807–814 (2005)Google Scholar
  4. 4.
    Komorowski, J., Rokita, P.: A Method for Novel Face View Synthesis Using Stereo Vision. In: Bolc, L., Tadeusiewicz, R., Chmielewski, L.J., Wojciechowski, K. (eds.) ICCVG 2010. LNCS, vol. 6375, pp. 49–56. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  5. 5.
    Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision 47, 7–42 (2002)CrossRefzbMATHGoogle Scholar
  6. 6.
    Schreer, O., Kauff, P., Sikora, T.: 3D Videocommunication, Algorithms, concepts, and real-time systems in human centered communication (2005)Google Scholar
  7. 7.
    Telea, A.: An image inpainting technique based on the fast marching method. Journal of Graphics, GPU, and Game Tools 9, 23–34 (2004)Google Scholar
  8. 8.
    Turk, M.A., Pentland, A.P.: Face Recognition Using Eigenfaces. In: Proceedings of Computer Vision and Pattern Recognition, CVPR 1991, pp. 586–591 (1991)Google Scholar
  9. 9.
    Voit, M., Nickel, K., Stiefelhagen, R.: Head Pose Estimation in Single- and Multi-view Environments – Results on the CLEAR07 Benchmarks. In: Stiefelhagen, R., Bowers, R., Fiscus, J.G. (eds.) RT 2007 and CLEAR 2007. LNCS, vol. 4625, pp. 307–316. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  10. 10.
    Zhao, W., Chellappa, R.: Image-based Face Recognition: Issues and Methods. In: Javidi, B. (ed.) Image Recognition and Classification, Marcel Dekker, New York Basel (2002)Google Scholar
  11. 11.
    Zhao, W., Chellappa, R., Rosenfeld, A., Phillips, P.: Face Recognition: A Literature Survey. ACM Computing Surveys 35(4), 399–458 (2003)CrossRefGoogle Scholar
  12. 12.
    Zhang, Z.: A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(11), 1330–1334 (2000)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Jacek Komorowski
    • 1
  • Przemyslaw Rokita
    • 2
  1. 1.Institute of Computer ScienceMaria Curie-Sklodowska UniversityLublinPoland
  2. 2.Institute of Computer ScienceWarsaw University of TechnologyWarsawPoland

Personalised recommendations