Skip to main content
SpringerLink
Log in
Book cover

Integrating Face and Voice in Person Perception pp 299–323Cite as

The Role of Audition in Audiovisual Perception of Speech and Emotion in Children with Hearing Loss

  • Chapter
  • First Online:

Abstract

Integration of visual and auditory cues during perception provides us with redundant information that greatly facilitates processing. Hearing loss affects access to the acoustic cues essential to accurate perception of speech and emotion, potentially impacting audiovisual integration. This chapter explores the various factors that may impact auditory processing in persons with hearing loss, including communication environment, modality preferences, and the use of hearing aids versus cochlear implants. Audiovisual processing of both speech and emotion by children with hearing loss is also discussed.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Bahrick, L. E., & Lickliter, R. (2000). Intersensory redundancy guides attentional selectivity and perceptual learning in infancy. Developmental Psychology, 36(2), 190–201.

    PubMed  CAS  Google Scholar 

  • Banks, M. S., & Salapatek, P. (1983). Infant visual perception. In M. M. Haith & J. H. Campos (Eds.), Handbook of child psychology: Infancy and developmental psychobiology (Vol. 2). New York: Wiley.

    Google Scholar 

  • Bergeson, T. R., Houston, D. M., & Miyamoto, R. T. (2010). Effects of congenital hearing loss and cochlear implantation on audiovisual speech perception in infants and children. Restorative Neurology and Neuroscience, 28, 157–165.

    PubMed  Google Scholar 

  • Bergeson, T. R., Pisoni, D. B., & Davis, R. A. O. (2003). A longitudinal study of audiovisual speech perception by children who have hearing loss who have cochlear implants. The Volta Review, 103(4), 347–370.

    PubMed  Google Scholar 

  • Bergeson, T. R., Pisoni, D. B., & Davis, R. A. O. (2005). Development of audiovisual comprehension skills in prelingually deaf children with cochlear implants. Ear and Hearing, 26, 149–164.

    PubMed  Google Scholar 

  • Bernstein, L. E., Demorest, M. E., & Tucker, P. E. (2000). Speech perception without hearing. Perception & Psychophysics, 62, 233–252.

    CAS  Google Scholar 

  • Besle, J., Fort, A., Delpuech, C., & Giard, M. (2004). Bimodal speech: Early suppressive visual effects in human auditory cortex. European Journal of Neuroscience, 20, 2225–2234.

    PubMed  Google Scholar 

  • Blamey, P. J., Sarant, J. Z., Paatsch, L. E., Barry, J. G., Bow, C. P., Wales, R. J., et al. (2001). Relationships among perception, production, language, hearing loss, and age in children with hearing impairment. Journal of Speech, Language, and Hearing Research, 44, 264–285.

    PubMed  CAS  Google Scholar 

  • Brancazio, L., & Miller, J. L. (2005). Use of visual information in speech perception: Evidence for a visual rate effect both with and without a McGurk effect. Perception & Psychophysics, 67(5), 759–769.

    Google Scholar 

  • Burkhardt, F., & Sendlmeier, W. F. (2000). Verification of acoustical correlates of emotional speech using formant-synthesis. Paper presented at the ISCA Workshop on Speech and Emotion, Northern Ireland.

    Google Scholar 

  • Capek, C. M., MacSweeney, M., Woll, B., Waters, D., McGuire, P. K., David, A. S., et al. (2008). Cortical circuits for silent speechreading in deaf and hearing people. Neuropsychologia, 46, 1233–1241.

    PubMed  Google Scholar 

  • Champoux, F., Lepore, F., Gagne, J., & Theoret, H. (2009). Visual stimuli can impair auditory processing in cochlear implant users. Neuropsychologia, 47, 17–22.

    PubMed  Google Scholar 

  • Chatterjee, M., & Peng, S. (2008). Processing F0 with cochlear implants: Modulation frequency discrimination and speech intonation recognition. Hearing Research, 235, 143–156.

    PubMed  Google Scholar 

  • Collignon, O., Girard, S., Gosselin, F., Roy, S., Saint-Amour, D., Lassonde, M., et al. (2008). Audio-visual integration of emotional expression. Brain Research, 1242, 126–135.

    PubMed  CAS  Google Scholar 

  • Compton, M. V., & Niemeyer, J. A. (1994). Expression of affection in young children with sensory impairments: A research agenda. Education and Treatment of Children, 17(1), 68–85.

    Google Scholar 

  • de Gelder, B., & Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition and Emotion, 14(3), 289–311.

    Google Scholar 

  • Dyck, M. J., & Denver, E. (2003). Can the emotion recognition ability of deaf children be enhanced? A pilot study. Journal of Deaf Studies and Deaf Education, 8(3), 348–356.

    PubMed  Google Scholar 

  • Elfenbein, H. A., Marsh, A., & Ambady, N. (2002). Emotional intelligence and the recognition of emotion from the face. In L. F. Barrett & P. Salovey (Eds.), The wisdom of feelings: Processes underlying emotional intelligence (pp. 37–59). New York: Guilford.

    Google Scholar 

  • Erber, N. P. (1972). Auditory, visual, and auditory-visual recognition of consonants by children with normal and impaired hearing. Journal of Speech and Hearing Research, 15, 413–422.

    PubMed  CAS  Google Scholar 

  • Eskritt, M., & Lee, K. (2003). Do actions speak louder than words? Preschool children’s use of the verbal-nonverbal consistency principle during inconsistent communication. Journal of Nonverbal Behavior, 27(1), 25–41.

    Google Scholar 

  • Faulkner, A., Rosen, S., & Smith, C. (2000). Effects of the salience of pitch and periodicity information on the intelligibility of four-channel vocoded speech: Implications for cochlear implants. Journal of the Acoustical Society of America, 108(4), 1877–1887.

    PubMed  CAS  Google Scholar 

  • Fitzpatrick, E., Angus, D., Durieux-Smith, A., Graham, I. D., & Coyle, D. (2008). Parents’ needs following identification of childhood hearing loss. American Journal of Audiology, 17, 38–49.

    PubMed  Google Scholar 

  • Friend, M. (2000). Developmental changes in sensitivity to vocal paralanguage. Developmental Science, 3(2), 148–162.

    Google Scholar 

  • Friesen, L. M., Shannon, R. V., Baskent, D., & Wang, X. (2001). Speech recognition in noise as a function of the number of spectral channels: Comparison of acoustic hearing and cochlear implants. Journal of the Acoustical Society of America, 110(2), 1150–1163.

    PubMed  CAS  Google Scholar 

  • Fu, Q., & Shannon, R. V. (1999). Phoneme recognition by cochlear implant users as a function of signal-to-noise ratio and nonlinear amplitude mapping. Journal of the Acoustical Society of America, 106(2), 18–23.

    Google Scholar 

  • Gantz, B. J., Turner, C., Gfeller, K. E., & Lowder, M. W. (2005). Preservation of hearing in cochlear implant surgery: Advantages of combined electrical and acoustical speech processing. The Laryngoscope, 115, 796–802.

    PubMed  Google Scholar 

  • Geers, A., & Brenner, C. (1994). Speech perception results: Audition and lipreading enhancement. The Volta Review, 96, 97–108.

    Google Scholar 

  • Geers, A., Brenner, C., & Davidson, L. (2003). Factors associated with development of speech perception skills in children implanted by age five. Ear and Hearing, 24(1), 24–35.

    Google Scholar 

  • Geurts, L., & Wouters, J. (2001). Coding of the fundamental frequency in continuous interleaved sampling processors for cochlear implants. Journal of the Acoustical Society of America, 109(2), 713–726.

    PubMed  CAS  Google Scholar 

  • Giezen, M. R., Escudero, P., & Baker, A. (2010). Use of acoustic cues by children with cochlear implants. Journal of Speech, Language, and Hearing Research, 53, 1440–1457.

    PubMed  Google Scholar 

  • Giraud, A., Price, C. J., Graham, J. M., Truy, E., & Frackowiak, S. J. (2001). Cross-modal plasticity underpins language recovery after cochlear implantation. Neuron, 30, 657–663.

    PubMed  CAS  Google Scholar 

  • Giraud, A., & Truy, E. (2002). The contribution of visual areas to speech comprehension: A PET study in cochlear implants patients and normal-hearing subjects. Neuropsychologia, 40, 1562–1569.

    PubMed  Google Scholar 

  • Grant, K. W., & Seitz, P. F. (2000). The use of visible speech cues for improving auditory detection of spoken sentences. Journal of the Acoustical Society of America, 108(3), 1197–1208.

    PubMed  CAS  Google Scholar 

  • Grant, K. W., Walden, B. E., & Seitz, P. F. (1998). Auditory-visual speech recognition by hearing-impaired subjects: Consonant recognition, sentence recognition, and auditory-visual integration. Journal of the Acoustical Society of America, 103(5), 2677–2690.

    PubMed  CAS  Google Scholar 

  • Gravel, J. S., & O’Gara, J. (2003). Communication options for children with hearing loss. Mental Retardation and Developmental Disabilities Research Reviews, 9, 243–251.

    PubMed  Google Scholar 

  • Green, T., Faulkner, A., Rosen, S., & Macherey, O. (2005). Enhancement of temporal periodicity cues in cochlear implants: Effects on prosodic perception and vowel identification. Journal of the Acoustical Society of America, 118(1), 375–385.

    PubMed  Google Scholar 

  • Grimwade, J. C., Walker, D. W., Bartlett, M., Gordon, S., & Wood, C. (1971). Human fetal heart rate change and movement in response to sound and vibration. American Journal of Obstetrics and Gynecology, 109(1), 86–90.

    PubMed  CAS  Google Scholar 

  • Harrison, R., Gordon, K., & Mount, R. (2005). Is there a critical period of congenitally deaf children? Analyses of hearing and speech perception performance after implantation. Developmental Psychobiology, 46(3), 252–261.

    PubMed  Google Scholar 

  • Hay-McCutcheon, M. J., Pisoni, D. B., & Kirk, K. I. (2005). Audiovisual speech perception in elderly cochlear implant recipients. The Laryngoscope, 115, 1887–1894.

    PubMed  Google Scholar 

  • Healy, E. W., & Bacon, S. P. (2002). Across-frequency comparison of temporal speech information by listeners with normal and impaired hearing. Journal of Speech, Language, and Hearing Research, 45, 1262–1275.

    PubMed  Google Scholar 

  • Henning, R. L. W., & Bentler, R. A. (2008). The effects of hearing aid compression parameters on the short-term dynamic range of continuous speech. Journal of Speech, Language, and Hearing Research, 51, 471–484.

    PubMed  Google Scholar 

  • Hietanen, J., Leppanen, J., Illi, M., & Surakka, V. (2004). Evidence for the integration of audiovisual emotional information at the perceptual level of processing. European Journal of Cognitive Psychology, 16(6), 769–790.

    Google Scholar 

  • Holt, R. F., Kirk, K. I., Eisenberg, L. S., Martinez, A. S., & Campbell, W. (2005). Spoken word recognition development in children with residual hearing using cochlear implants and hearing aids in opposite ears. Ear and Hearing, 26(4), 82–91.

    Google Scholar 

  • Hopyan-Misakyan, T. M., Gordon, K., Dennis, M., & Papsin, B. (2009). Recognition of affective speech prosody and facial affect in deaf children with unilateral right cochlear implants. Child Neuropsychology, 15(2), 136–146.

    PubMed  Google Scholar 

  • Hosie, J. A., Gray, C. D., Russell, P. A., Scott, C., & Hunter, N. (1998). The matching of facial expressions by deaf and hearing children and their production and comprehension of emotion labels. Motivation and Emotion, 22(4), 293–313.

    Google Scholar 

  • Houston, D. M., Pisoni, D. B., Kirk, K. I., Ying, E. A., & Miyamoto, R. T. (2003). Speech perception skills of deaf infants following cochlear implantation: A first report. International Journal of Pediatric Otorhinolaryngology, 67(479–495).

    Google Scholar 

  • Jenstad, L. M., Pumford, J., Seewald, R. C., & Cornelisse, L. E. (2000). Comparison of linear gain and wide dynamic range compression hearing aid circuits II: Aided loudness measures. Ear and Hearing, 21(1), 32–44.

    PubMed  CAS  Google Scholar 

  • Kaiser, A. R., Kirk, K. I., Lachs, L., & Pisoni, D. B. (2003). Talker and lexical effects on audiovisual word recognition by adults with cochlear implants. Journal of Speech, Language, and Hearing Research, 46, 390–404.

    PubMed  Google Scholar 

  • Kirk, K. I., Hay-McCutcheon, M. J., Holt, R. F., Gao, S., Qi, R., & Gerlain, B. L. (2007). Audiovisual spoken word recognition by children with cochlear implants. Audiological Medicine, 5, 250–261.

    PubMed  Google Scholar 

  • Knutson, J. F., Boyd, R. C., Reid, J. B., Mayne, T., & Fetrow, R. (1997). Observational assessments of the interaction of implant recipients with family and peers: Preliminary findings. Otolaryngology – Head and Neck Surgery, 117(3), 196–207.

    PubMed  CAS  Google Scholar 

  • Kong, Y., Stickney, G. S., & Zeng, F. (2005). Speech and melody recognition in binaurally combined acoustic and electric hearing. Journal of the Acoustical Society of America, 117(3), 1351–1361.

    PubMed  Google Scholar 

  • Kurtzer-White, E., & Luterman, D. (2003). Families and children with hearing loss: Grief and coping. Mental Retardation and Developmental Disabilities Research Reviews, 9, 232–235.

    PubMed  Google Scholar 

  • Lachs, L., Pisoni, D. B., & Kirk, K. I. (2001). Use of audiovisual information in speech perception by prelingually deaf children with cochlear implants: A first report. Ear and Hearing, 22(3), 236–251.

    PubMed  CAS  Google Scholar 

  • Ling, D. (1989). Foundations of spoken language for hearing-impaired children. Washington, DC: Alexander Graham Bell Association for the Deaf.

    Google Scholar 

  • Loizou, P. C., Dorman, M., & Fitzke, J. (2000). The effect of reduced dynamic range on speech understanding: Implications for patients with cochlear implants. Ear and Hearing, 21(1), 25–31.

    PubMed  CAS  Google Scholar 

  • Loizou, P. C., Poroy, O., & Dorman, M. (2000). The effect of parametric variations of cochlear implant processors on speech understanding. Journal of the Acoustical Society of America, 108(2), 790–802.

    PubMed  CAS  Google Scholar 

  • Marschark, M. (Ed.). (1993). Psychological development of deaf children. New York: Oxford University Press.

    Google Scholar 

  • Massaro, D. W. (1999). Speechreading: Illusion or window into pattern recognition. Trends in Cognitive Science, 3(8), 310–317.

    Google Scholar 

  • Massaro, D. W., & Cohen, M. M. (1999). Speech perception in perceivers with hearing loss: Synergy of multiple modalities. Journal of Speech, Language, and Hearing Research, 42, 21–41.

    PubMed  CAS  Google Scholar 

  • Massaro, D. W., & Egan, P. (1996). Perceiving affect from the voice and face. Pscyhonomic Bulletin and Review, 3, 215–221.

    Google Scholar 

  • Massaro, D. W., & Light, J. (2004). Using visible speech to train perception and production of speech for individuals with hearing loss. Journal of Speech, Language, and Hearing Research, 42(2), 304–320.

    Google Scholar 

  • Maxim, L. A., & Nowicki, S. J., Jr. (2003). Developmental associations between nonverbal ability and social competence. Facta Universitatis, 2(10), 745–758.

    Google Scholar 

  • Mayer, J. D., Salovey, P., & Caruso, D. R. (2004). Emotional intelligence: Theory, findings, and implications. Psychological Inquiry, 15(3), 197–215.

    Google Scholar 

  • McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746–748.

    PubMed  CAS  Google Scholar 

  • Meyer, T. A., Svirsky, M. A., Kirk, K. I., & Miyamoto, R. T. (1998). Improvements in speech perception by children with profound prelingual hearing loss: Effects of device, communication mode, and chronological age. Journal of Speech, Language, and Hearing Research, 41, 846–858.

    PubMed  CAS  Google Scholar 

  • Mitchell, R. E., & Karchmer, M. A. (2004). Chasing the mythical ten percent: Parental hearing status of deaf and hard of hearing students in the United States. Sign Language Studies, 4, 138–163.

    Google Scholar 

  • Mitchell, T. V., & Maslin, M. T. (2007). How vision matters for individuals with hearing loss. International Journal of Audiology, 46, 500–511.

    PubMed  Google Scholar 

  • Morton, J. B., & Trehub, S. E. (2001). Children’s understanding of emotions in speech. Child Development, 72(3), 834–843.

    PubMed  CAS  Google Scholar 

  • Most, T., & Aviner, C. (2009). Auditory, visual, and auditory-visual perception of emotions by individuals with cochlear implants, hearing aids, and normal hearing. Journal of Deaf Studies and Deaf Education, 14(4), 449–464.

    PubMed  Google Scholar 

  • Most, T., Weisel, A., & Zaychik, A. (1993). Auditory, visual and auditory-visual identification of emotions by hearing and hearing-impaired adolescents. British Journal of Audiology, 27, 247–253.

    PubMed  CAS  Google Scholar 

  • Napolitano, A. C., & Sloutsky, V. M. (2004). Is a picture worth a thousand words? The flexible nature of modality dominance in young children. Child Development, 75(6), 1850–1870.

    PubMed  Google Scholar 

  • O’Donoghue, G. M., Nikolopoulos, T. P., & Archbold, S. M. (2000). Determinants of speech perception in children after cochlear implantation. The Lancet, 356, 466–468.

    Google Scholar 

  • Oster, A. M., & Risberg, A. (1986). The identification of the mood of a speaker by hearing-impaired listeners. SLT-Quarterly Progress Status Report, 4, 79–90.

    Google Scholar 

  • Pell, M. (2005). Nonverbal emotion priming: Evidence from the ‘facial affect decision task’. Journal of Nonverbal Behavior, 29(1), 45–73.

    Google Scholar 

  • Peng, S., Tomblin, J. B., & Turner, C. W. (2008). Production and perception of speech intonation in pediatric cochlear implant recipients and individuals with normal hearing. Ear and Hearing, 29(3), 336–351.

    PubMed  Google Scholar 

  • Peters, K., Remmel, E., & Richards, D. (2009). Language, mental state vocabulary, and false belief understanding in children with cochlear implants. Language, Speech, and Hearing Services in Schools, 40(3), 245–255.

    PubMed  Google Scholar 

  • Power, D. J., & Hyde, M. B. (1997). Multisensory and unisensory approaches to communicating with deaf children. European Journal of Psychology of Education, 12(4), 449–464.

    Google Scholar 

  • Rieffe, C., & Terwogt, M. M. (2000). Deaf children’s understanding of emotions: Desires take precedence. Journal of Child Psychology and Psychiatry, 41, 601–608.

    PubMed  CAS  Google Scholar 

  • Robbins, A. M., Koch, D. B., Osberger, M. J., Zimmerman-Phillips, S., & Kishon-Rabin, L. (2004). Effect of age at cochlear implantation on auditory skill development in infants and toddlers. Archives of Otolaryngology – Head & Neck Surgery, 130, 570–574.

    Google Scholar 

  • Robinson, C. W., & Sloutsky, V. M. (2004). Auditory dominance and its change in the course of development. Child Development, 75(5), 1387–1401.

    PubMed  Google Scholar 

  • Sadato, N., Yamada, H., Okada, T., Yoshida, M., Hasegawa, T., Matsuki, K., et al. (2004). Age-dependent plasticity in the superior temporal sulcus in deaf humans: A functional fMRI study. BMC Neuroscience, 5(56), 1–6.

    Google Scholar 

  • Sarant, J. Z., Blamey, P. J., Dowell, R. C., Clark, G. M., & Gibson, W. P. R. (2001). Variation in speech perception scores among children with cochlear implants. Ear and Hearing, 22(1), 18–28.

    PubMed  CAS  Google Scholar 

  • Scherer, K. R. (2003). Vocal communication of emotion: A review of research paradigms. Speech Communication, 40, 227–256.

    Google Scholar 

  • Schorr, E. A., Fox, N. A., van Wassenhove, V., & Knudsen, E. I. (2005). Auditory-visual fusion in speech perception in children with cochlear implants. Proceedings of the National Academy of Sciences, 102(51), 18748–18750.

    CAS  Google Scholar 

  • Schorr, E. A., Roth, F. P., & Fox, N. A. (2009). Quality of life for children with cochlear implants: Perceived benefits and problems and the perception of single words and emotional sounds. Journal of Speech, Language, and Hearing Research, 52, 141–152.

    PubMed  Google Scholar 

  • Seewald, R. C., Ross, M., Giolas, T. G., & Yonovitz, A. (1985). Primary modality for speech perception in children with normal and impaired hearing. Journal of Speech and Hearing Research, 28, 36–46.

    PubMed  CAS  Google Scholar 

  • Shannon, R. V. (2002). The relative importance of amplitude, temporal, and spectral cues for cochlear implant processor design. American Journal of Audiology, 11, 124–127.

    PubMed  Google Scholar 

  • Sharma, A., Dorman, M. F., & Spahr, A. J. (2002). A sensitive period for the development of the central auditory system in children with cochlear implants: Implications for age of implantation. Ear and Hearing, 6, 532–539.

    Google Scholar 

  • Sininger, Y., Grimes, A., & Christensen, E. (2010). Auditory development in early amplified children: Factors influencing auditory-based communication outcomes in children with hearing loss. Ear and Hearing, 31(2), 166–185.

    PubMed  Google Scholar 

  • Sloutsky, V. M., & Napolitano, A. C. (2003). Is a picture worth a thousand words? Preference for auditory modality in young children. Child Development, 74(3), 822–833.

    PubMed  Google Scholar 

  • Snik, A. F. M., Makhdooum, M. J. A., Vermeulen, A. M., Brokx, J. P. L., & van den Broek, P. (1997). The relation between age at the time of cochlear implantation and long-term speech perception abilities in congenitally deaf subjects. International Journal of Pediatric Otorhinolaryngology, 41, 121–131.

    PubMed  CAS  Google Scholar 

  • Sommers, M. S., Tye-Murray, N., & Spehar, B. (2005). Auditory-visual speech perception and auditory-visual enhancement in normal-hearing younger and older adults. Ear and Hearing, 26(3), 263–275.

    PubMed  Google Scholar 

  • Staller, S. J., Dowell, R. C., Beiter, A. L., & Brimacombe, J. A. (1991). Perceptual abilities of children with the Nucleus 22-Channel cochlear implant. Ear and Hearing, 12(4), 34–47.

    Google Scholar 

  • Stelmachowicz, P. G., Pittman, A. L., Hoover, B. M., & Lewis, D. E. (2001). Effect of stimulus bandwidth on the perception of /s/ in normal- and hearing-impaired children and adults. Journal of the Acoustical Society of America, 110(4), 2183–2190.

    PubMed  CAS  Google Scholar 

  • Stelmachowicz, P. G., Pittman, A. L., Hoover, B. M., Lewis, D. E., & Moeller, M. P. (2004). The importance of high-frequency audibility in the speech and language development of children with hearing loss. Archives of Otolaryngology – Head & Neck Surgery, 130, 556–562.

    Google Scholar 

  • Strelnikov, K., Rouger, J., Barone, P., & Deguine, O. (2009). Role of speechreading in audiovisual interactions during the recovery of speech comprehension in deaf adults with cochlear implants. Scandinavian Journal of Psychology, 50(5), 437–444.

    PubMed  CAS  Google Scholar 

  • Svirsky, M. A., Robbins, A. M., Kirk, K. I., Pisoni, D. B., & Miyamoto, R. T. (2000). Language development in profoundly deaf children with cochlear implants. Psychological Science, 11(2), 153–158.

    PubMed  CAS  Google Scholar 

  • Turner, C. W., Chi, S., & Flock, S. (1999). Limiting spectral resolution in speech for listeners with sensorineural hearing loss. Journal of Speech, Language, and Hearing Research, 42, 773–784.

    PubMed  CAS  Google Scholar 

  • Turner, C. W., Souza, P. E., & Forget, L. N. (1995). Use of temporal envelope cues in speech recognition by normal and hearing-impaired listeners. Journal of the Acoustical Society of America, 97, 2568–2576.

    PubMed  CAS  Google Scholar 

  • Tye-Murray, N., Sommers, M., & Spehar, B. (2007). Auditory and visual lexical neighborhoods in audiovisual speech perception. Trends in Amplification, 11(4), 233–242.

    PubMed  Google Scholar 

  • Vandell, D. L., & George, L. B. (1981). Social interaction in hearing and deaf preschoolers: Successes and failures in initiations. Child Development, 52(2), 627–635.

    PubMed  CAS  Google Scholar 

  • Wie, O. B. (2010). Language development in children after receiving bilateral cochlear implants between 5 and 18 months. International Journal of Pediatric Otorhinolaryngology, 74(11), 1258–1266.

    PubMed  Google Scholar 

  • Zupan, B., Neumann, D., Babbage, D. R., & Willer, B. (2009). The importance of vocal affect to bimodal processing of emotion: Implications for individuals with traumatic brain injury. Journal of Communication Disorders, 42, 1–17.

    PubMed  Google Scholar 

  • Zupan, B., & Sussman, J. E. (2009). Auditory preferences of young children with and without hearing loss for meaningful auditory-visual compound stimuli. Journal of Communication Disorders, 42, 381–396.

    PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Applied Linguistics, Brock University, 500 Glenridge Ave., St. Catharines, ON, Canada, L2S 3A1

    Barbra Zupan

Authors
  1. Barbra Zupan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Barbra Zupan .

Editor information

Editors and Affiliations

  1. Dept. Psychology, Voice Neurocognition Lab., University of Glasgow, Glasgow, Glasgow, G12 8QB, United Kingdom

    Pascal Belin

  2. Brugmann University Hospital, Brussels, B-1020, Belgium

    Salvatore Campanella

  3. University of Tubingen, Tubingen, 72074, Germany

    Thomas Ethofer

1 Electronic Supplementary material

An example of an incongruent audiovisual emotional stimulus would be combining an angry facial expression with a sad vocal expression. (2 MB)

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Zupan, B. (2013). The Role of Audition in Audiovisual Perception of Speech and Emotion in Children with Hearing Loss. In: Belin, P., Campanella, S., Ethofer, T. (eds) Integrating Face and Voice in Person Perception. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-3585-3_15

Download citation

Publish with us

Policies and ethics

Search

Navigation