Fusion of Infrared and Range Data: Multi-modal Face Images

  • Xin Chen
  • Patrick J. Flynn
  • Kevin W. Bowyer
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3832)


Infrared and range imagery are intriguing sensing modalities for face recognition systems. They may offer better performance than other modalities due to their robustness to environmental effects and deliberate attempts to obscure identity. Furthermore, a combination of these modalities may offer additional discrimination power. Toward this end, we present a semi-automatic system that captures range and infrared data of a human subject’s face, registers and integrates multiple 3D views into one model, and applies the infrared measurements as a registered texture map.


Face Recognition Range Data Range Image Point Pair Face Surface 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Jain, A., Bolle, R., Pankanti, S.: Biometrics: Personal Identification in Networked Society. Kluwer Academic Publishers, Dordrecht (1999)Google Scholar
  2. 2.
    Zhao, W., Chellappa, R., Rosenfeld, A., Phillips, J.: Face Recognition: A Literature Survey. Univ. of MD Tech. Rep. CFAR-TR00-948 (2000)Google Scholar
  3. 3.
    Adini, Y., Moses, Y., Ullman, S.: Face Recognition: The Problem of Compensating for Changes in Illumination Direction. In: Proc. ECCV, A, pp. 286–296 (1994)Google Scholar
  4. 4.
    Wilder, J., et al.: Comparison of Visible and Infrared Im-agery for face Recognition. In: Proc. Int. Conf. Autom. Face and Gesture Recog., pp. 192–187 (1996)Google Scholar
  5. 5.
    Wolff, L., Socolinsky, D., Eveland, C.: Quantitative Measurement of Illumination In-variance for Face Recognition Using Thermal Infrared Imagery. In: Proc. Workshop Com-puter Vision Beyond the Visible Spectrum, Kauai (December 2001)Google Scholar
  6. 6.
    Cutler, R.: Face Recognition Using Infrared Images and Eigenfaces (1996),
  7. 7.
    Socolinsky, S., Selinger, A.: A Comparative Analysis of face Recognition Perform-ance with Visible and Thermal Infrared Imagery, Tech Rep., Equinox Corp. (2001)Google Scholar
  8. 8.
    Selinger, A., Socolinsky, D.: Appearance-Based Facial Recognition Using Visible and Thermal Imagery: A Comparative Study. In: Proc. Int. Conf. Pattern Recognition, Quebec City (2002)Google Scholar
  9. 9.
    Gordon, G.: Face Recognition based on Depth Maps and Surface Curvature. In: Proc. SPIE 1570, pp. 234–247 (1991)Google Scholar
  10. 10.
    Beumier, C., Acheroy, M.: Automatic Face Verification from 3D and Grey Level Clues. In: Proc. 11th Portuguese Conference on Pattern Recognition (RECPAD 2000) (September 2000)Google Scholar
  11. 11.
    Yacoob, Y., Davis, L.: Labeling of Human Face Components from Range Data. CVGIP 60(2), 168–178 (1994)CrossRefGoogle Scholar
  12. 12.
    Lapreste, J., Cartoux, J., Richetin, M.: Face Recognition from Range Data by Structral Analysis. NATO ASI Series v. F45 (Syntactic and Structural Pattern Recognition). Springer, Heidelberg (1988)Google Scholar
  13. 13.
    Chua, C., Jarvis, R.: Point Signatures: A New Representation for 3D Object Recogni-tion. Int. J. Comp. Vision 25(1), 63–85 (1997)CrossRefGoogle Scholar
  14. 14.
    Achermann, B., Jiang, X., Bunke, H.: Face Recognition using Range Images. In: Proc. International Conference on Virtual Systems and MultiMedia 1997, Ge-neva,Switzerland, September 1997, pp. 129–136 (1997)Google Scholar
  15. 15.
    Wang, Y., Chua, C., Ho, Y.: Facial Feature Detection and Face Recognition from 2D and 3D Images. Pattern Recognition Letters 23(10), 1191–1202 (1991)CrossRefGoogle Scholar
  16. 16.
    Chang, S., Rioux, M., Domey, J.: Recognition with Range Images and Intensity Im-ages. Optical Engineering 36(4), 1106–1112 (1997)CrossRefGoogle Scholar
  17. 17.
    Beumier, C., Acheroy, M.: Automatic Face Authentification from 3D Surface. In: Proc. 1998 British Machine Vision Conference, September 1998, pp. 449–458 (1998)Google Scholar
  18. 18.
    Schutz, C., Jost, T., Hugli, H.: Semi-Automatic 3D Object Digitizing System Using Range Images. In: Proc. ACCV (1998)Google Scholar
  19. 19.
    Besl, P.J., McKay, N.D.: A Method for Registration of 3-D Shapes. IEEE Trans. on PAMI 14(2), 239–256 (1992)Google Scholar
  20. 20.
    Wolberg, G.: Digital Image Warping. Wiley-IEEE Press (1990)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Xin Chen
    • 1
  • Patrick J. Flynn
    • 1
  • Kevin W. Bowyer
    • 1
  1. 1.Dept. of Computer Science and EngineeringUniversity of Notre DameNotre DameUSA

Personalised recommendations