Highly Accurate and Fast Face Recognition Using Near Infrared Images

  • Stan Z. Li
  • RuFeng Chu
  • Meng Ao
  • Lun Zhang
  • Ran He
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3832)


In this paper, we present a highly accurate, realtime face recognition system for cooperative user applications. The novelties are: (1) a novel design of camera hardware, and (2) a learning based procedure for effective face and eye detection and recognition with the resulting imagery. The hardware minimizes environmental lighting and delivers face images with frontal lighting. This avoids many problems in subsequent face processing to a great extent. The face detection and recognition algorithms are based on a local feature representation. Statistical learning is applied to learn most effective features and classifiers for building face detection and recognition engines. The novel imaging system and the detection and recognition engines are integrated into a powerful face recognition system. Evaluated in real-world user scenario, a condition that is harder than a technology evaluation such as Face Recognition Vendor Tests (FRVT), the system has demonstrated excellent accuracy, speed and usability.


  1. 1.
    Ahonen, T., Hadid, A., Pietikainen, M.: Face recognition with local binary patterns. In: Proceedings of the European Conference on Computer Vision, Prague, Czech, pp. 469–481 (2004)Google Scholar
  2. 2.
    Beveridge, J.R., She, K., Draper, B.A., Givens, G.H.: A nonparametric statistical comparison of principal component and linear discriminant subspaces for face recognition. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 535–542 (2001)Google Scholar
  3. 3.
    Bowyer, K.W., Chang, Flynn, P.J.: A survey of 3D and multi-modal 3d+2d face recognition. In: Proceedings of International Conference Pattern Recognition, August 2004, pp. 358–361 (2004)Google Scholar
  4. 4.
    Chang, K.I., Bowyer, K.W., Flynn, P.J.: An evaluation of multi-modal 2D+3D face biometrics. IEEE Transactions on Pattern Analysis and Machine Intelligence (2005) (to appear)Google Scholar
  5. 5.
    Chellappa, R., Wilson, C., Sirohey, S.: Human and machine recognition of faces: A survey. Proceedings of the IEEE 83, 705–740 (1995)CrossRefGoogle Scholar
  6. 6.
    CVBVS. IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (1999-2003)Google Scholar
  7. 7.
    Dowdall, J., Pavlidis, I., Bebis, G.: Face detection in the near-IR spectrum. Image and Vision Computing 21, 565–578 (2003)CrossRefGoogle Scholar
  8. 8.
    Freund, Y., Schapire, R.: A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences 55(1), 119–139 (1997)zbMATHCrossRefMathSciNetGoogle Scholar
  9. 9.
    Hadid, A., Pietikinen, M., Ahonen, T.: A discriminative feature space for detecting and recognizing faces. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 797–804 (2004)Google Scholar
  10. 10.
    Kong, S.G., Heo, J., Abidi, B., Paik, J., Abidi, M.: Recent advances in visual and infrared face recognition - A review. Computer Vision and Image Understanding 97(1), 103–135 (2005)CrossRefGoogle Scholar
  11. 11.
    Li, D.-Y., Liao, W.-H.: Facial feature detection in near-infrared images. In: Proc. of 5th International Conference on Computer Vision, Pattern Recognition and Image Processing, Cary, NC, September 2003, pp. 26–30 (2003)Google Scholar
  12. 12.
    Moghaddam, B., Nastar, C., Pentland, A.: A Bayesain similarity measure for direct image matching. In: Media Lab Tech Report No.393, August 1996. MIT, Cambridge (1996)Google Scholar
  13. 13.
    OTCBVS. In: IEEE International Workshop on Object Tracking and Classification in and Beyond the Visible Spectrum (2004-2005)Google Scholar
  14. 14.
    Pan, Z., Healey, G., Prasad, M., Tromberg, B.: Face recognition in hyperspectral images. IEEE Transactions on Pattern Analysis and Machine Intelligence 25(12), 1552–1560 (2003)CrossRefGoogle Scholar
  15. 15.
    Phillips, P.J., et al.: An introduction to evaluating biometric system. IEEE Computer (Special issue on biometrics), 56–63 (February 2000)Google Scholar
  16. 16.
    Samal, A., Iyengar, P.A.: Automatic recognition and analysis of human faces and facial expressions: A survey. Pattern Recognition 25, 65–77 (1992)CrossRefGoogle Scholar
  17. 17.
    Valentin, D., Abdi, H., O’Toole, A.J., Cottrell, G.W.: Connectionist models of face processing: A survey. Pattern Recognition 27(9), 1209–1230 (1994)CrossRefGoogle Scholar
  18. 18.
    Viola, P., Jones, M.: Robust real time object detection. In: IEEE ICCV Workshop on Statistical and Computational Theories of Vision, Vancouver, Canada, July 13 (2001)Google Scholar
  19. 19.
    Zhang, G., Huang, X., Li, S.Z., Wang, Y., Wu, X.: Boosting local binary pattern (LBP)-based face recognition. In: Li, S.Z., Lai, J.-H., Tan, T., Feng, G.-C., Wang, Y. (eds.) SINOBIOMETRICS 2004. LNCS, vol. 3338, pp. 180–187. Springer, Heidelberg (2004)Google Scholar
  20. 20.
    Zhao, W., Chellappa, R.: Image based face recognition, issues and methods. In: Javidi, B. (ed.) Image Recognition and Classification, pp. 375–402. Mercel Dekker, New York (2002)Google Scholar
  21. 21.
    Zhao, W., Chellappa, R., Phillips, P., Rosenfeld, A.: Face recognition: A literature survey. ACM Computing Surveys, 399–458 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Stan Z. Li
    • 1
  • RuFeng Chu
    • 1
  • Meng Ao
    • 1
  • Lun Zhang
    • 1
  • Ran He
    • 1
  1. 1.Center for Biometrics and Security Research & National Laboratory of Pattern Recognition, Institute of AutomationChinese Academy of SciencesBeijingChina

Personalised recommendations