Perception & Psychophysics

, Volume 66, Issue 4, pp 574–583

Spatial frequency requirements for audiovisual speech perception

  • K. G. Munhall
  • C. Kroos
  • G. Jozan
  • E. Vatikiotis-Bateson
Article

DOI: 10.3758/BF03194902

Cite this article as:
Munhall, K.G., Kroos, C., Jozan, G. et al. Perception & Psychophysics (2004) 66: 574. doi:10.3758/BF03194902
  • 284 Downloads

Abstract

Spatial frequency band-pass and low-pass filtered images of a talker were used in an audiovisual speech-in-noise task. Three experiments tested subjects’ use of information contained in the different filter bands with center frequencies ranging from 2.7 to 44.1 cycles/face (c/face). Experiment 1 demonstrated that information from a broad range of spatial frequencies enhanced auditory intelligibility. The frequency bands differed in the degree of enhancement, with a peak being observed in a mid-range band (11-c/face center frequency). Experiment 2 showed that this pattern was not influenced by viewing distance and, thus, that the results are best interpreted in object spatial frequency, rather than in retinal coordinates. Experiment 3 showed that low-pass filtered images could produce a performance equivalent to that produced by unfiltered images. These experiments are consistent with the hypothesis that high spatial resolution information is not necessary for audiovisual speech perception and that a limited range of spatial frequency spectrum is sufficient.

Download to read the full article text

Copyright information

© Psychonomic Society, Inc. 2004

Authors and Affiliations

  • K. G. Munhall
    • 1
  • C. Kroos
    • 2
  • G. Jozan
    • 2
  • E. Vatikiotis-Bateson
    • 2
    • 3
  1. 1.Department of PsychologyQueen’s UniversityKingstonCanada
  2. 2.ATR Human Information Science LaboratoriesKyotoJapan
  3. 3.University of British ColumbiaVancouverCanada