Abstract
How do observers recognize faces despite dramatic image variations that arise from changes in illumination? This paper examines (1) whether face recognition is sensitive to illumination direction and (2) whether cast shadows improve performance by providing information about illumination or hinder performance by introducing spurious edges. In Experiment 1, observers judged whether two sequentially presented faces, illuminated from the same direction or different directions, were the same individual or not. Cast shadows were present for half of the observers. Performance was impaired by a change in the illumination direction and by the presence of shadows. In Experiment 2, observers learned to name eight faces under one illumination direction (left/right) and one cast-shadow condition (present/absent); they were later tested under novel illumination and shadow conditions. Performance declined for unfamiliar illumination directions, but not for unfamiliar shadow conditions. The finding that face recognition is illumination dependent is consistent with the use of image-based representations. The results indicate that face recognition processes are sensitive to either the direction of lighting or the resultant pattern of shading, and that cast shadows can hinder recognition, possibly by masking informative features or leading to spurious contours.
Article PDF
Similar content being viewed by others
References
Adini, Y., Moses, Y., & Ullman, S. (1995). Face recognition: The problem of compensating for changes in illumination direction (Rep. No. CS93-21). Rehovot, Israel: Weizmann Institute of Science.
Beck, J. (1972). Surface color perception. Ithaca, NY: Cornell University Press.
Belhumeur, P. N. (1997). The bas-relief ambiguity. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (pp. 1060–1066). Los Alamitos, CA: IEEE Computer Society Press.
Belhumeur, P. [N.], & Kriegman, D. (1996). What is the set of images of an object under all possible lighting conditions? In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (pp. 270–277). Los Alamitos, CA: IEEE Computer Society Press.
Berbaum, K., Bever, T., & Chung, C. S. (1983). Light source position in the perception of object shape. Perception, 12, 411–416.
Biederman, I. (1987). Recognition-by-components: A theory of human image understanding. Psychological Review, 94, 115–147.
Biederman, I, & Cooper, E. E. (1991). Evidence for complete translational and reflectional invariance in visual object priming. Perception, 20, 585–593.
Biederman, I., & Cooper, E. E. (1992). Size invariance in visual object priming. Journal of Experimental Psychology: Human Perception & Performance, 18, 121–133.
Biederman, I., & Ju, G. (1988). Surface versus edge-based determinants of visual recognition. Cognitive Psychology, 20, 38–64.
Braje, W. L., Legge, G. E., & Kersten, D. (1998). Invariant recognition of natural objects in the presence of shadows. Manuscript submitted for publication.
Bülthoff, H. H., Edelman, S. Y., & Tarr, M. J. (1995). How are three-dimensional objects represented in the brain? Cerebral Cortex, 5, 247–260.
Cavanagh, P. (1991). What’s up in top-down processing? In A. Gorea (Eds.), Representations of vision: Trends and tacit assumptions in vision research (pp. 295–304). Cambridge: Cambridge University Press.
Christou, C. G., & Koenderink, J. J. (1996). Shape from shading and shape constancy under variations in illumination. Investigative Ophthalmology & Visual Science, 37, S934.
Cooper, E. E., Biederman, I., & Hummel, J. E. (1992). Metric invariance in object recognition: A review and further evidence. Canadian Journal of Psychology, 46, 191–214.
Desimone, R., Albright, T. D., Gross, C. G., & Bruce, C. (1984). Stimulus-selective properties of inferior temporal neurons in the macaque. Journal of Neuroscience, 4, 2051–2062.
Edelman, S. (1995). Class similarity and viewpoint invariance in the recognition of 3D objects. Biological Cybernetics, 72, 207–220.
Ellis, R., & Allport, D. A. (1986). Multiple levels of representation for visual objects: A behavioural study. In A. G. Cohn & J. R. Thomas (Eds.), Artificial intelligence and its applications (pp. 245–257). New York: Wiley.
Epstein, R., Hallinan, P. W., & Yuille, A. L. (1995). 5 ± eigenimages suffice: An empirical investigation of low-dimensional lighting models. In IEEE Workshop on Physics-Based Modeling in Computer Vision (pp. 108–116). Los Alamitos, CA: IEEE Computer Society Press.
Fiser, J., & Biederman, I. (1995). Size invariance in visual object priming of gray-scale images. Perception, 24, 741–748.
Gauthier, I., & Tarr, M. J. (1997). Becoming a “greeble” expert: Exploring mechanisms for face recognition. Vision Research, 37, 1673–1682.
Hallinan, P. W. (1994). A low-dimensional lighting representation of human faces for arbitrary lighting conditions. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (pp. 995–999). Los Alamitos, CA: IEEE Computer Society Press.
Hallinan, P. W. (1995). A deformable model for face recognition under arbitrary lighting conditions. Unpublished doctoral dissertation, Division of Applied Sciences, Harvard University.
Hayes, T., Morrone, M. C., & Burr, D. C. (1986). Recognition of positive and negative bandpass-filtered images. Perception, 15, 595–602.
Hietanen, J. K., Perrett, D. I., Oram, M. W., Benson, P. J., & Dittrich, W. H. (1992). The effects of lighting conditions on responses of cells selective for face views in the macaque temporal cortex. Experimental Brain Research, 89, 157–171.
Hill, H., & Bruce, V. (1996). Effects of lighting on the perception of facial surfaces. Journal of Experimental Psychology: Human Perception & Performance, 22, 986–1004.
Ito, M., Tamura, H., Fujita, I., & Tanaka, K. (1995). Size and position invariance of neuronal responses in monkey inferotemporal cortex. Journal of Neurophysiology, 73, 218–226.
Kersten, D., O’Toole, A. J., Sereno, M. E., Knill, D. C., & Anderson, J. A. (1987). Associative learning of scene parameters from images. Applied Optics, 26, 4999–5006.
Macmillan, N. A., & Creelman, C. D. (1991). Detection theory: A user’s guide. New York: Cambridge University Press.
Marr, D., & Nishihara, H. K. (1978). Representation and recognition of the spatial organization of three-dimensional shapes. Philosophical Transactions of the Royal Society of London: Series B, 200, 269–294.
Moore, C., & Cavanagh, P. (1998). Recovery of 3D volume from 2-tone images of novel objects. Cognition, 67, 45–71.
Moses, Y., Ullman, S., & Edelman, S. (1996). Generalization to novel images in upright and inverted faces. Perception, 25, 443–462.
Murase, H., & Nayar, S. (1995). Visual learning and recognition of 3-D objects from appearance. Internationaljournal of Computer Vision, 14, 5–24.
Pentland, A. P. (1990). Linear shape from shading. International Journal of Computer Vision, 4, 153–162.
Perrett, D. I., Oram, M. W., Harries, M. H., Bevan, R., Hietanen, J. K., & Benson, P. J. (1991). Viewer-centred and object-centred coding of heads in the macaque temporal cortex. Experimental Brain Research, 86, 159–173.
Poggio, T., & Edelman, S. (1990). A network that learns to recognize three-dimensional objects. Nature, 343, 263–266.
Rolls, E. T. (1992). Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas. Philosophical Transactions of the Royal Society of London: Series B, 335, 11–21.
Rolls, E. T., Baylis, G. C., & Leonard, C. M. (1985). Role of low and high spatial frequencies in the face-selective responses of neurons in the cortex in the superior temporal sulcus in the monkey. Vision Research, 25, 1021–1035.
Shashua, A. (1992). Illumination and view position in 3D visual recognition. In J. E. Moody, S. J. Hanson, & R. P. Lippmann (Eds.), Advances in neural information processing systems 4 (pp. 404–411). San Mateo, CA: Morgan Kaufmann.
Shashua, A. (1996). On photometric issues in 3D visual recognition from a single 2D image. International Journal of Computer Vision, 21, 99–122.
Tarr, M. J., & Bülthoff, H. H. (1995). Is human object recognition better described by geon-structural-descriptions or by multiple-views? Journal of Experimental Psychology: Human Perception & Performance, 21, 1494–1505.
Tarr, M. J., Kersten, D., & Bülthoff, H. H. (1998). Why the visual recognition system might encode the effects of illumination. Vision Research, 38, 2259–2275.
Tovee, M. J., Rolls, E. T., & Azzopardi, P. (1994). Translation invariance in the responses to faces of single neurons in the temporal visual cortical areas of the alert macaque. Journal of Neurophysiology, 72, 1049–1060.
Troje, N. F., & Bülthoff, H. H. (1996). Face recognition under varying poses: The role of texture and shape. Vision Research, 36, 1761–1771.
Troje, N. F., & Bülthoff, H. H. (1998). How is bilateral symmetry of human faces used for recognition of novel views? Vision Research, 38, 79–89.
Ullman, S. (1996). High-level vision: Object recognition and visual cognition. Cambridge, MA: MIT Press.
Warrington, E. K. (1982). Neuropsychological studies of object recognition. Philosophical Transactions of the Royal Society of London: Series B, 298, 15–33.
Weiskrantz, L. (1990). Visual prototypes, memory, and the infero-temporal lobe. In E. Iwai & M. Mishkin (Eds.), Vision, memory, and the temporal lobe (pp. 13–28). New York: Elsevier.
Williams, P., & Tarr, M. J. (1998). RSVP: Experimental control software for MacOS [On-line]. Available: http://psych.umb.edu/rsvp/
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by grants from the National Science Foundation (SBR-9631682), National Institutes of Health (EY02857), Air Force Office of Scientific Research (F49620-91-J-0169), NATO, and the Max-Planck-Institut für biologische Kybernetik.
Rights and permissions
About this article
Cite this article
Braje, W.L., Kersten, D., Tarr, M.J. et al. Illumination effects in face recognition. Psychobiology 26, 371–380 (1998). https://doi.org/10.3758/BF03330623
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3758/BF03330623