Skip to main content

Visual influences on speech perception processes

Abstract

An experiment is reported, the results of which confirm and extend an earlier observation that visual information for the speaker’s lip movements profoundly modifies the auditorv perception of natural speech by normally hearing subjects. The effect is most pronounced when there is auditory information for a bilabial utterance combined with visual information for a nonlabial utterance. However, the effect is also obtained with the reverse combination, although to a lesser extent. These findings are considered for their relevance to auditory theories of speech perception.

References

  1. Abbs, J. H., &Sussman, H. M. Neurophysiological feature detectors and speech perception: A discussion of theoretical implications.Journal of Speech and Hearing Research, 1971,14, 23–26.

    PubMed  Google Scholar 

  2. Binnie, C. A., Montgomery, A. A., &Jackson, P. L. Auditory and visual contributions to the perception of consonants.Journal of Speech and Hearing Research, 1974,17, 619–630.

    PubMed  Google Scholar 

  3. Conrad, R. Lip reading by deaf and hearing children.British Journal of Educational Psychology, 1977,47, 60–65.

    PubMed  Google Scholar 

  4. Cutting, J. E. Auditory and linguistic processes in speech perception: Inferences from six fusions in dichotic listening.Psychological Review, 1976,83, 114–140.

    Article  PubMed  Google Scholar 

  5. Dodd, B. The role of vision in the perception of speech.Perception, 1977,6, 31–40.

    Article  PubMed  Google Scholar 

  6. Eimas, P. D., Cooper, W. E., &Corbit, J. D. Some properties of linguistic feature detectors.Perception & Psychophysics, 1973,13, 247–252.

    Google Scholar 

  7. Liberman, A. M., Cooper, F. S., Shankweiler, D. P., &Studert-Kennedy, M. Perception of the speech code.Psychological Review, 1967,74, 431–461.

    Article  PubMed  Google Scholar 

  8. McGurk, H., &Macdonald, J. Hearing lips and seeing voices.Nature, 1976,264, 746–748.

    Article  PubMed  Google Scholar 

  9. Miller, G. A., &Nicely, P. E. An analysis of perceptual confusions among some English consonants.Journal of the Acoustical Society of America, 1955,27, 338–353.

    Article  Google Scholar 

  10. Pelson, R. O., &Prather, W. F. Effects of visual message-related cues, age and hearing impairment on speech reading performance.Journal of Speech and Hearing Research, 1974,17, 518–525.

    PubMed  Google Scholar 

  11. Siegel.S.Nonparametric statistics for the behavioral sciences. New York: McGraw-Hill. 1956.

    Google Scholar 

  12. Stevens, K. N., &House, A. S. Speech perception. In J. Tobias (Ed.),Foundations of modern auditory theory (Vol. 11) New York: Academic Press, 1972. Pp. 3–62.

    Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Harry McGurk.

Additional information

This research was supported by a grant from the U.K. Leverhulme Trust Fund to author McGurk.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Macdonald, J., McGurk, H. Visual influences on speech perception processes. Perception & Psychophysics 24, 253–257 (1978). https://doi.org/10.3758/BF03206096

Download citation

Keywords

  • Auditory Stimulus
  • Speech Perception
  • Auditory Information
  • Dichotic Listening
  • Stop Consonant