View-Based Recognition of Faces in Man and Machine: Re-visiting Inter-extra-Ortho
For humans, faces are highly overlearned stimuli, which are encountered in everyday life in all kinds of poses and views. Using psychophysics we investigated the effects of viewpoint on human face recognition. The experimental paradigm is modeled after the inter-extra-ortho experiment using unfamiliar objects by Bülthoff and Edelman . Our results show a strong viewpoint effect for face recognition, which replicates the earlier findings and provides important insights into the biological plausibility of view-based recognition approaches (alignment of a 3D model, linear combination of 2D views and view-interpolation). We then compared human recognition performance to a novel computational view-based approach  and discuss improvements of view-based algorithms using local part-based information.
Unable to display preview. Download preview PDF.
- 4.Blanz, V., Vetter, T. (1999). A Morphable Model for the Synthesis of 3D Faces. In Proc. Siggraph99, pp. 187–194.Google Scholar
- 5.Bülthoff, H.H., Edelman, S. (1992). Psychophysical support for a two-dimensional view interpolation theory of object recognition. PNAS USA, 89, 60–64.Google Scholar
- 8.Edelman, S. Intrator, N. (2000). A productive, systematic framework for the representation of visual structure. In Proc. NIPS 2000, 10–16.Google Scholar
- 9.Goren, C., Sarty, M., Wu, P. (1975). Visual following and pattern discrimination of facelike stimuli by newborn infants. Pediatrics, 56, 544–549.Google Scholar
- 10.Heisele, B., Serre, T., Pontil, M., Vetter, T., and Poggio, T. (2001). Categorization by learning and combining object parts. In Proc. NIPS 2001.Google Scholar
- 16.Marr, D. (1982). Vision. San Francisco: Freeman.Google Scholar
- 20.Pilu, M. (1997). A direct method for stereo correspondence based on singular value decomposition, In Proc. CVPR’97, 261–266.Google Scholar
- 21.Schwaninger, A., Mast, F. (1999). Why is face recognition so orientation-sensitive? Psychophysical evidence for an integrative model. Perception, 28 (Suppl.), 116.Google Scholar
- 26.Ullman, S., Sali, E. (2000). Object Classification Using a Fragment-Based Representation. In Proc. BMCV’00, 73–87.Google Scholar
- 28.Wallis, G. M., Bülthoff, H.H. (2001). Effect of temporal association on recognition memory. PNAS USA, 98, 4800–4804.Google Scholar
- 29.Wallraven, C., Bülthoff, H.H. (2001). Automatic acquisition of exemplar-based representations for recognition from image sequences. CVPR 2001 — Workshop on Models vs. Exemplars.Google Scholar
- 30.Wallraven, C., Bülthoff, H.H. (2001). View-based recognition under illumination changes using local features. CVPR 2001—Workshop on Identifying Objects Across Variations in Lighting: Psychophysics and Computation.Google Scholar
- 31.Weber M., Welling M. and Perona P. (2000). Unsupervised Learning of Models for Recognition. In Proc. ECCV2000.Google Scholar