Abstract
This chapter describes and provides behavioral and neurophysiological evidence articulating how the intersensory redundancy hypothesis addresses the question of how infants integrate faces and voices in perceiving other people. Infants’ learning of the arbitrary relationship between faces and voices occurs in two tightly coupled steps. First, between 3 and 5 months of age infants attend to various amodal properties such as a common tempo, rhythm, and affective expressions that unite a particular face and voice. Second, around 6 months of age, when infants’ attention is more flexible and they perceive amodal and modality-specific properties, infants perceive and remember various arbitrary features (i.e., the sound of particular voice and the visual appearance of a particular face) associated with a particular face–voice pairing.
To appear in P. Belin, S. Campanella, & T. Ethofer (Eds.) Integrating Face and Voice in Person Perception. Springer.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Allen TW, Walker K, Symonds L, Marcell M (1977) Intrasensory and intersensory perception of temporal sequences during infancy. Developmental Psychology 13:225–229
Bahrick LE (2000) Increasing specificity in the development of intermodal perception. In: Muir D, Slater A (eds) Infant development: The essential readings. Blackwell, Maklen, MA, pp 117–136
Bahrick LE (2001) Increasing specificity in perceptual development: Infants’ detection of nested levels of multimodal stimulation. Journal of Experimental Child Psychology 79:253–270
Bahrick LE (2010) Intermodal perception and selective attention to intersensory redundancy: Implications for typical social development and autism. In: Bremner G, Wachs TD (eds) Blackwell handbook of infant development, 2nd edn. Blackwell, London
Bahrick LE, Flom R, Lickliter R (2002) Intersensory redundancy facilitates discrimination of tempo in 3-month-old infants. Developmental Psychobiology 41:352–363
Bahrick LE, Hernandez-Reif M, Flom R (2005) The development of infant learning about specific face-voice relations. Developmental Psychology 41:541–552
Bahrick LE, Lickliter R (2000) Intersensory redundancy guides attentional selectivity and perceptual learning in infancy. Developmental Psychology 36:190–201
Bahrick LE, Lickliter R (2002) Intersensory redundancy guides early perceptual and cognitive development. In: Kail R (ed) Advances in child development and behavior, vol 30. Academic, New York, pp 153–187
Bahrick LE, Lickliter R (2004) Infants’ perception of rhythm and tempo in unimodal and multimodal stimulation: A developmental test of the intersensory redundancy hypothesis. Cognitive, Affective, & Behavioral Neuroscience 4:137–147
Bahrick LE, Lickliter R, Flom R (2004) Intersensory redundancy guides the development of selective attention, perception, and cognition in infancy. Current Directions in Psychological Science 13:99–102
Bahrick LE, Lickliter R, Flom R (2006) Up versus down: The role of intersensory redundancy in infants’ sensitivity to object orientation and motion. Infancy 9:73–96
Bahrick LE, Moss L, Fadil C (1996) The development of visual self-recognition in infancy. Ecological Psychology 8:189–208
Bahrick LE, Netto DS, Hernandez-Reif M (1998) Intermodal perception of adult child faces and voices by infants. Child Development 69:1263–1275
Balaban MT, Dannemiller JL (1992) Age differences in responses to temporally modulated patterns at 6 and 12 weeks. Infant Behavior & Development 15:359–375
Barrera M, Maurer D (1981) Recognition of mother’s photographed face by the three month old infant. Child Development 52:714–716
Besle J, Fort A, Delpuech C, Giard M (2004) Bimodal speech: Early suppressive visual effects in human auditory cortex. The European Journal of Neuroscience 20(8):2225–2234
Birch, H., & Lefford, A. (1963). Intersensory development in children. Monographs of the Society for Research in Child Development, 28(5, Serial No. 89).
Braida LD (1991) Crossmodal integration in the identification of consonant segments. The Quarterly Journal of Experimental Psychology 43(3):647–677
Bristow D, Dehaene-Lambertz G, Mattout J, Soares C, Gliga T, Mangin J (2009) Hearing faces: How the infant brain matches the face it sees with the speech it hears. Journal of Cognitive Neuroscience 21(5):905–921
Brookes H, Slater A, Quinn PC, Lewkowicz DJ, Hayes R, Brown E (2001) Three-month-old infants learn arbitrary auditory-visual pairings between voices and faces. Infant and Child Development 10:75–82
Bushnell IWR (1982) Discrimination of faces by young infants. Journal of Experimental Psychology 33:298–308
Calvert GA, Hansen PC, Iversen SD, Brammer MJ (2001) Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. NeuroImage 14(2):427–438
Cooper RP, Aslin RN (1990) Preference for infant-directed speech in the first month after birth. Child Development 61:1584–1595
DeCasper AJ, Fifer W (1980) Of human bonding: Newborns prefer their mothers’ voices. Science 208:1174–1176
DeCasper AJ, Prescott PA (1984) Human newborns’ perception of male voices: Preference, discrimination, and reinforcing value. Developmental Psychobiology 5:481–491
DeCasper AJ, Spence M (1986) Prenatal maternal speech influences newborns’ perception of speech sounds. Infant Behavior & Development 9:133–150
Dodd B (1979) Lip reading in infants: Attention to speech presented in-and-out of synchrony. Cognitive Psychology 11:478–484
Edelman GM (1987) Neural Darwinism: The theory of neuronal group selection. Basic Books, New York, NY
Edelman GM (1993) Neural Darwinism: Selection and reentrant signaling in higher brain function. Neuron 10:115–125
Fantz R (1963) Pattern vision in newborn infants. Science 140(3564):296–297
Farah MJ, Wilson KD, Drain M, Tanaka JN (1998) What is “special” about face perception. Psychological Review 105(3):482–498
Fernald A (1985) Four-month-old infants prefer to listen to motherese. Infant Behavior & Development 8:181–195
Field TM, Cohen D, Garcia R, Greenberg R (1984) Mother-stranger face discrimination by the newborn infant. Infant Behavior & Development 7:19–25
Flom R, Bahrick L (2007) The effects of multimodal stimulation on infants’ discrimination of affect: An examination of the intersensory redundancy hypothesis. Developmental Psychology 43:238–252
Flom R, Bahrick LE (2010) The effects of intersensory redundancy on attention and memory: Infants’ long-term memory for orientation in audiovisual events. Developmental Psychology 46:428–436
Flom R, Pick AD (2005) Experimenter affective expression and gaze following in 7-month-olds. Infancy 7:207–218
Flom R, Whipple H, Hyde D (2009) Infants’ intermodal perception of canine (Canis familairis) facial expressions and vocalizations. Developmental Psychology 45:1143–1151
Fort A, Delpuech C, Pernier J, Giard MH (2002a) Dynamics of cortico-subcorical crossmodal operations involved in audio-visual object detection in humans. Cerebral Cortex 12:1031–1039
Fort A, Delpuech C, Pernier J, Giard MH (2002b) Early auditory-visual interactions in human cortex during nonredundant target identification. Cognitive Brain Research 14:20–30
Gardner JM, Karmel BZ (1995) Development of arousal/attention preference interactions in early infancy. Developmental Psychology 31:473–482
Giard MH, Peronnet F (1999) Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience 11:473–490
Gibson JJ (1966) The senses considered as perceptual systems. Houghton Mifflin, Boston
Gibson EJ (1969) Principles of perceptual learning and development. Appleton Century Crofts, New York, NY
Gibson JJ (1979) The ecological approach to visual perception. Houghton Mifflin, Boston
Goodale MA, Milner AD (1992) Separate visual pathways for perception and action. Trends in Neurosciences 15:20–25
Gray CM (1999) The temporal correlation hypothesis of visual feature integration: Still alive and well. Neuron 24:31–47
Green KP (1998) The use of auditory and visual information during phonetic processing: Implications for theories of speech perception. In: Campbell R, Dodd B, Burnham D (eds) Hearing by eye II. Psychology Press, East Sussex, UK
Grossman T (2012) The early development and brain bases of emotion perception in face and voice. In: Belin P, Campanella S, Ethofer T (eds) Integrating face and voice in person perception. Springer, Berlin
Grossmann T, Striano T, Friederici AD (2006) Crossmodal integration of emotional information from face and voice in the infant brain. Developmental Science 9(3):309–315
Hyde DC, Jones BL, Flom R, Porter CL (2011) Neural signatures of face-voice synchrony in 5-month-old human infants. Developmental Psychobiology 53:359–370
Hyde DC, Jones BL, Porter CL, Flom R (2010) Visual stimulation enhances auditory processing in 3-month-old infants and adults. Developmental Psychobiology 52(2):181–189
James W (1890) The principles of psychology. Dover Publications, New York, 1950 (vol. 1, pp. 159, 488)
Kuhl PK, Meltzoff AN (1984) The intermodal representation of speech in infants. Infant Behavior & Development 7:361–381
Lewkowicz DJ (1988a) Sensory dominance in infants: 1. Six-month-old infants’ response to auditory-visual compounds. Developmental Psychology 24:155–171
Lewkowicz DJ (1988b) Sensory dominance in infants: 2. Ten-month-old infants’ response to auditory-visual compounds. Developmental Psychology 24:172–182
Lewkowicz DJ (2000) The development of intersensory temporal perception: An epigenetic systems/limitations view. Psychological Bulletin 126:281–308
Lewkowicz D (2010) Infant perception of audio-visual speech synchrony. Developmental Psychology 46(1):66–77
Lickliter R, Bahrick LE, Honeycutt H (2004) Intersensory redundancy enhances memory in bobwhite quail embryos. Infancy 5:253–269
Lickliter R, Bahrick LE, Markham RG (2006) Intersensory redundancy educates selective attention in bobwhite quail embryos. Developmental Science 9:604–615
Maurer D, Barerra M (1981) Infants’ perception of natural and distorted arrangements of a schematic face. Child Development 52:196–202
Mehler J, Jusczyk P, Lambertz G, Halsted N, Bertoncini J, Amiel-Tison C (1988) A precursor of language acquisition in young infants. Cognition 29:143–178
Moon C, Cooper RP, Fifer WP (1993) Two-day-olds prefer their native language. Infant Behavior & Development 16(4):495–500
Morrongiello BA, Trehub SE (1987) Age-related changes in auditory temporal perception. Journal of Experimental Child Psychology 44:413–426
Nelson CA (2001) The development and neural bases of face recognition. Infant and Child Development 10:3–18
Pascalis O, de Schonen S (1994) Recognition in 3- to 4-day-old human neonates. Neuroreport 5:1721–1724
Pascallis O, Kelly DJ (2009) The origins of face processing in humans: Phylogeny and ontogeny. Perspectives on Psychological Science 4:200–209
Pegg JE, Werker JF, McLeod PJ (1992) Preference for infant-directed over adult- directed speech: Evidence from 7-week-old infants. Infant Behavior & Development 15(3):325–345
Piaget J (1952) The origins of intelligence in children. International Universities Press, New York
Pilling M (2009) Auditory event-related potentials (ERPs) in audiovisual speech perception. Journal of Speech, Language, and Hearing Research 52(4):1073–1081
Puce A (2012) Neurophysiological correlates of face and voice integration. In: Belin P, Campanella S, Ethofer T (eds) Integrating face and voice in person perception. Springer, Berlin
Querleu D, Renard X, Boutteville C, Crepin G (1989) Hearing by the human fetus? Seminars in Perinatology 13:409–420
Querleu D, Renard X, Versyp F, Paris-Delrue L, Crepin G (1988) Fetal hearing. European Journal of Obstetrics, Gynecology, and Reproductive Biology 29:191–212
Reynolds GD, Richards JE (2005) Familiarization, attention, and recognition memory in infancy: An event-related potential and cortical source localization study. Developmental Psychology 41:598–615
Rosenblum LD, Schmuckler MA, Johnson JA (1997) The McGurk effect in infants. Perception & Psychophysics 59:347–357
Royce J (1881) “Mind-stuff” and reality. Mind 6(23):365–377
Sai F, Bushnell IWR (1988) The perception of faces in different poses by 1-month-olds. The British Journal of Developmental Psychology 6:35–41
Santangelo V, Van der Lubbe RHJ, Olivetti Berlardinelli M, Postma A (2008) Multisensory integration affects ERP components elicited by exogenous cues. Experimental Brain Research 185:269–277
Seth AK, McKinstry JL, Edelman GM, Krichmar JL (2004) Visual binding through reentrant connectivity and dynamic synchronization in a brain-based device. Cerebral Cortex 14(11):1185–1199
Shadlen MN, Movshon JA (1999) Synchrony unbound: A critical evaluation of the temporal binding hypothesis. Neuron 26:703–714
Shafritz KM, Gore JC, Marios R (2002) The role of parietal cortex in feature binding. Proceedings of the National Academy of Sciences 99:10917–10922
Singer W (1999) Neuronal synchrony: A versatile code for the definition of relations? Neuron 24:49–65
Singh L, Morgan JL, Best CT (2002) Infants’ listening preferences: Baby talk or happy talk? Infancy 3:365–394
Spector F, Maurer DM (2009) Synesthesia: A new approach to understanding the development of perception. Developmental Psychology 45:175–189
Spelke ES, Owsley CJ (1979) Intermodal exploration and knowledge in infancy. Infant Behavior & Development 2:13–27
Treisman A (1996) The binding problem. Current Opinion in Neurobiology 6:171–178
Treisman A (1998) Feature binding, attention and object perception. Philosophical transactions of the Royal Society of London Series B, Biological sciences 353:1295–1306
Ungerlieder LG, Mishkin M (1982) Two cortical visual systems. MIT Press, Cambridge, MA
van Wassenhove V, Grant KW, Poeppel D (2005) Visual speech speeds up the neural processing of auditory speech. Proceedings of the National Academy of Sciences of the United States of America 102:1181–1186
Walker AS (1982) Intermodal perception of expressive behaviors by human infants. Journal of Experimental Child Psychology 13:514–535
Walker-Andrews AS, Bahrick LE, Raglioni SS, Diaz I (1991) Infants’ bimodal perception of gender. Ecological Psychology 3:55–75
Wallace MT, Stein BE (1997) Development of multisensory neurons and multisensory integration in cat superior colliculus. Journal of Neuroscience 17:2429–2444
Wallace MT, Wilkinson LK, Stein BE (1996) Representation and integration of multiple sensory inputs in primate superior colliculus. Journal of Neurophysiology 76(2):1246–1266
Zeki SM (1991) Cerebral akinetopsia (visual motion blindness). Brain 114:811–824
Zeki SM (1993) A vision of the brain. Blackwell, Oxford, UK
Acknowledgments
Sir Isaac Newton is credited with the expression “If I have seen further, it is by standing on the shoulders of giants.” The research and thoughts contained within this chapter reflect a portion of the knowledge I acquired as a post-doc working and conversing with Lorraine Bahrick, her husband and colleague Robert Lickliter, and countless conversations with David Lewkowicz. In many respects each of these individuals could rightly claim authorship. Without their guidance and collaboration this chapter would not be possible and I am indebted to each. I am equally indebted to the students and the parents of the many infants who participated in experiments described herein.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media New York
About this chapter
Cite this chapter
Flom, R. (2013). Intersensory Perception of Faces and Voices in Infants. In: Belin, P., Campanella, S., Ethofer, T. (eds) Integrating Face and Voice in Person Perception. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-3585-3_4
Download citation
DOI: https://doi.org/10.1007/978-1-4614-3585-3_4
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-3584-6
Online ISBN: 978-1-4614-3585-3
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)