International Journal of Computer Vision

, Volume 74, Issue 2, pp 167–181 | Cite as

A Component-based Framework for Face Detection and Identification

  • Bernd Heisele
  • Thomas Serre
  • T. Poggio
Article

Abstract

We present a component-based framework for face detection and identification. The face detection and identification modules share the same hierarchical architecture. They both consist of two layers of classifiers, a layer with a set of component classifiers and a layer with a single combination classifier. The component classifiers independently detect/identify facial parts in the image. Their outputs are passed the combination classifier which performs the final detection/identification of the face.

We describe an algorithm which automatically learns two separate sets of facial components for the detection and identification tasks. In experiments we compare the detection and identification systems to standard global approaches. The experimental results clearly show that our component-based approach is superior to global approaches.

Keywords

face detection face identification face recognition object detection object recognition support vector machines components fragments parts hierarchical classification 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Beymer, D.J. 1993. Face recognition under varying pose. Center for Biological and Computational Learning, M.I.T., Cambridge, MA, A.I. Memo 1461.Google Scholar
  2. Bileschi, S.M. and Heisele, B. 2002. Advances in component-based face detection. In Proceedings of Pattern Recognition with Support Vector Machines, First International Workshop, SVM 2002, Niagara Falls, pp. 135–143.Google Scholar
  3. Blanz, V. and Vetter, T. 1999. A morphable model for synthesis of 3D faces. In Computer Graphics Proceedings SIGGRAPH, Los Angeles, pp. 187–194.Google Scholar
  4. Brunelli, R. and Poggio, T. 1993. Face recognition: Features versus templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(10):1042–1052.CrossRefGoogle Scholar
  5. Dorko, G. and Schmid, C. 2003. Selection of scale invariant neighborhoods for object class recognition. In International Conference on Computer Vision (ICCV), pp. 634–640.Google Scholar
  6. Fergus, R., Perona, P., and Zisserman, A. 2003. Object class recognition by unsupervised scale-invariant learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 264–271.Google Scholar
  7. Gross, R. 2005. Face databases. In Handbook of Face Recognition, A. S. Li (ed.), Springer, New York.Google Scholar
  8. Heisele, B., Ho, P., Wu, J., and Poggio, T. 2003. Face recognition: Component-based versus global approaches. Computer Vision and Image Understanding (CVIU) 91(1–2):6–21.CrossRefGoogle Scholar
  9. Heisele, B., Serre, T., Mukherjee, S., and Poggio. T. 2003. Hierarchical classification and feature reduction for fast face detection with support vector machines. Pattern Recognition, 36(9):2007–2017.MATHCrossRefGoogle Scholar
  10. Heisele, B., Serre, T., Pontil, M., Vetter, T., and Poggio, T. 2001. Categorization by learning and combining object parts. In Neural Information Processing Systems (NIPS), Vancouver.Google Scholar
  11. Ivanov, Y., Heisele, B., and Serre, T. 2004. Using component features for face recognition. In Proceedings of the 6th International Conference on Automatic Face and Gesture Recognition, pp. 421–426.Google Scholar
  12. Lienhart, R., Kuranov, A., and Pisarevsky, V. 2003. Empirical analysis of detection cascades of boosted classifiers for rapid object detection. In DAGM'03, 25th Pattern Recognition Symposium, pp. 297–304.Google Scholar
  13. Lowe, D.G. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2):91–110.CrossRefGoogle Scholar
  14. Martinez, A.M. 2002. Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(6):748–763.CrossRefGoogle Scholar
  15. Mohan, A., Papageorgiou, C., and Poggio, T. 2001. Example-based object detection in images by components. In IEEE Transactions on Pattern Analysis and Machine Intelligence, 23:349–361.CrossRefGoogle Scholar
  16. Morgenstern, C. and Heisele, B. 2003. Component-based recognition of objects in an office environment. Center for Biological and Computational Learning, M.I.T., Cambridge, MA, A.I. Memo 232.Google Scholar
  17. Nefian, A. and Hayes, M. 1999. An embedded HMM-based approach for face detection and recognition. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 6, pp. 3553–3556.Google Scholar
  18. Oren, M., Papageorgiou, C., Sinha, P., Osuna, E., and Poggio. T. 1997. Pedestrian detection using wavelet templates. In IEEE Conference on Computer Vision and Pattern Recognition, San Juan, pp. 193–199.Google Scholar
  19. Osuna, E. 1998. Support vector machines: Training and applications. Ph.D. dissertation, MIT, Department of Electrical Engineering and Computer Science, Cambridge, MA.Google Scholar
  20. OpenCV Online Reference Manual. 2006. The Intel Corporation.Google Scholar
  21. Pentland, A., Mogghadam, B., and Starner, T. 1994. View-based and modular eigenspaces for face recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
  22. Phillips, P.J. 1998. Matching pursuit filters applied to face identification. IEEE Transactions on Image Processing, 7(8):1150–1164.CrossRefGoogle Scholar
  23. Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., and Worek, W. 2005. Overview of the face recognition grand challenge. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 947–954.Google Scholar
  24. Poggio, T. and Edelman, S. 1990. A network that learns to recognize 3-D objects. Nature, 343:163–266.CrossRefGoogle Scholar
  25. Riesenhuber, M. and Poggio, T. 1999. Hierarchical models of object recognition in cortex. Nature Neuroscience, 2(11):1019–1025.CrossRefGoogle Scholar
  26. Rowley, H.A., Baluja, S., and Kanade. T. 1998. Neural network-based face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(1):23–38.CrossRefGoogle Scholar
  27. Schneiderman, H. and Kanade, T. 2000. A statistical method for 3D object detection applied to faces and cars. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 746–751.Google Scholar
  28. Serre, T., Wolf, L., and Poggio, T. 2005. Object recognition with features inspired by visual cortex. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 994–1000.Google Scholar
  29. Sim, T., Baker, S., and Bsat, M. 2003. The CMU pose, illumination, and expression database. IEEE Transactions Pattern Analysis and Machine Intelligence (PAMI) 25(12):1615–1618.CrossRefGoogle Scholar
  30. Sung, K.-K. 1996. Learning and example selection for object and pattern recognition. Ph.D. dissertation, MIT, Artificial Intelligence Laboratory and Center for Biological and Computational Learning, Cambridge, MA.Google Scholar
  31. Ullman, S., Vidal-Naquet, M., and Sali, E. 2002. Visual features of intermdediate complexity and their use in classification. Nature Neuroscience, 5(7):682–687.Google Scholar
  32. Vetter, T. 1998. Synthesis of novel views from a single face. International Journal of Computer Vision, 28(2):103–116.CrossRefMathSciNetGoogle Scholar
  33. Viola, P. and Jones, M.J. 2004. Robust real-time face detection. International Journal of Computer Vision, 57(2):137–154.CrossRefGoogle Scholar
  34. Weber, M., Welling, W., and Perona, P. 2000. Towards automatic dscovery of object categories. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Google Scholar
  35. Wiskott, L., Fellous, J.-M., Krüger, N., and von der Malsburg, C. 1997. Face recognition by elastic bunch graph matching. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):775 –779.CrossRefGoogle Scholar
  36. Zhao, W., Chellappa, R., Phillips, P.J., and Rosenfeld, A. 2003. Face recognition: A literature survey. ACM Comput. Surv., 35(4):399–458.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2006

Authors and Affiliations

  • Bernd Heisele
    • 1
  • Thomas Serre
    • 2
  • T. Poggio
    • 2
  1. 1.Honda Research Institute USA in Cambridge and the Center for Biological and Computational Learning at M.I.T. CambridgeCambridgeUSA
  2. 2.the Department of Brain and Cognitive Sciences and the Computer Science and Artificial Intelligence Laboratory at M.I.T.McGovern Institute for Brain Research, the Center for Biological and Computational LearningCambridgeUSA

Personalised recommendations