Multisensory Interaction of Audiovisual Stimuli on the Central and Peripheral Spatial Locations: A Behavioral Study

  • Qi Li
  • Jingjing Yang
  • Noriyoshi Kakura
  • Jinglong Wu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5819)


Much knowledge has been gained about how the brain is activated on audiovisual interaction. However, few data was acquired about the relationship between audiovisual interaction and spatial locations of audiovisual stimuli. Here, we investigated the multisensory interaction of audiovisual stimuli presented on central and peripheral spatial locations. Firstly, we determined the maximal eccentricity of peripheral spatial location on where stimuli were presented which was 30°. Second, the results of audiovisual interaction showed that the interaction of visual and auditory can have dramatic effects on human perception and performance. Moreover, this effect depended on the spatial locations of presented audiovisual stimuli.


Target Stimulus Stimulus Type Stimulus Location Standard Stimulus Stimulus Modality 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Calvert, G.A., Spence, C., Stein, B.E. (eds.): The Handbook of Multisensory Processing. MIT Press, Cambridge (2004)Google Scholar
  2. 2.
    Lippert, M., Logothetis, N.K., Kayser, C.: Improvement of visual contrast detection by a simultaneous sound. Brain research 1173, 102–109 (2007)CrossRefGoogle Scholar
  3. 3.
    Gielen, S.C., Schmidt, R.A., Van den Heuvel, P.J.: On the nature of intersensory facilitation of reaction time. Percept. Psychophys 34, 161–168 (1983)CrossRefGoogle Scholar
  4. 4.
    Hershenson, M.: Reaction time as a measure of intersensory facilitation. J. Exp. Psychol. 63, 289–293 (1962)CrossRefGoogle Scholar
  5. 5.
    Posner, M.I., Nissen, M.J., Klein, R.M.: Visual dominance: an information-processing account of its origins and significance. Psychol. Rev. 83, 157–171 (1976)CrossRefGoogle Scholar
  6. 6.
    Seitz, A.R., Kim, R., Shams, L.: Sound facilitates visual learning. Curr. Biol. 16, 1422–1427 (2006)CrossRefGoogle Scholar
  7. 7.
    David Hairston, W., Hodges, D.A., Burdette, J.H., Wallace, M.T.: Auditory enhancement of visual temporal order judgmen. NeuroReport 17, 791–795 (2006)CrossRefGoogle Scholar
  8. 8.
    Slutsky, D.A., Recanzone, G.H.: Temporal and spatial dependency of the ventriloquism effect. NeuroReport 12, 7–10 (2001)CrossRefGoogle Scholar
  9. 9.
    Welch, R.B., Warren, D.H.: Immediate perceptual response to intersensory discrepancy. Psychol. Bull. 88, 638–667 (1980)CrossRefGoogle Scholar
  10. 10.
    Morein-Zamir, S., Soto-Faraco, S., Kingstone, A.: Auditory capture of vision: Examining temporal ventriloquisum. Cognit. Brain Research 17, 154–163 (2003)CrossRefGoogle Scholar
  11. 11.
    Spence, C., Driver, J.: Attracting attention to the illusory location of a sound reflexive crossmodal orienting and ventriloquism. NeuroReport 11, 2057–2061 (2000)CrossRefGoogle Scholar
  12. 12.
    Raab, D.: Statistical facilitation of simple reaction times. Transactions of the New York Academy of Sciences 24, 574–590 (1962)CrossRefGoogle Scholar
  13. 13.
    Eimer, M.: Attending to quadrants and ring-shaped regions: ERP effects of visual attention in different spatial selection tasks. Psychophysiology 36, 491–503 (1999)CrossRefGoogle Scholar
  14. 14.
    Lewald, J., Getzmann, S.: Horizontal and vertical effects of eye-position on sound localization. Hear Res. 213, 99–106 (2006)CrossRefGoogle Scholar
  15. 15.
    Simon, R., Sylvain, D., Pascal, D., Sabine, D.D., Jacques, H., Henrique, S.: Peripherally presented emotional scenes: A spatiotemporal analysis of early ERP response. Brain Topogr 20, 216–223 (2008)CrossRefGoogle Scholar
  16. 16.
    Anderson, R.: Aliasing in peripheral vision for counterphase gratings. J. Opt. Soc. Am A Opt. Image Sci. Vis. 13, 2288–2289 (1996)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Qi Li
    • 1
    • 3
  • Jingjing Yang
    • 1
  • Noriyoshi Kakura
    • 2
  • Jinglong Wu
    • 1
    • 4
  1. 1.Graduate School of Natural Science and TechnologyOkayama UniversityOkayamaJapan
  2. 2.Graduate School of EngineeringKagawa UniversityTakamatsuJapan
  3. 3.School of Computer Science and TechnologyChangchun University of Science and TechnologyChangchunChina
  4. 4.The International WIC InstituteBeijing University of TechnologyChina

Personalised recommendations