Psychoacoustic Manipulation of the Sound-Induced Illusory Flash

  • Sonia Wilkie
  • Catherine Stevens
  • Roger Dean
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4969)

Abstract

Psychological research on cross-modal auditory-visual perception has focused on the manipulation of sensory information predominantly by visual information. There are relatively few studies of the way auditory stimuli may affect other sensory information.

The Sound-induced Illusory Flash is one illusory paradigm that involves the auditory system biasing other senses. However, little is known about the cross-modal illusion. More research is needed into the structure of the illusion that investigates the different conditions under which the Sound-induced Illusory Flash manifests and is enhanced or reduced.

The experiment reported here investigates the effect of new auditory stimulus variables on the Sound-induced Illusory Flash. The variables to be discussed concern forming a contrast in the auditory stimulus to emphasise the illusory percept. The auditory contrasts used were single pitched beeps versus those alternating in pitch by an octave, and the presentation of sound monaurally versus binaurally.

The ultimate aim is to develop the illusory effect as a basis for new intermedia techniques and creative applications for the temporal manipulation and spatialisation of visual objects.

Keywords

Sound-induced Illusory Flash cross-modal illusion multisensory interaction auditory-visual perception temporal bias pitch interval spatialisation 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Alais, D., Burr, D.: The ventriloquist effect results from near-optimal bi-modal integration. Current Biology 14, 257–262 (2004)Google Scholar
  2. 2.
    Bhattacharya, J., Shams, L., Shimojo, S.: Sound-induced Illusory Flash Perception: Role of Gamma Band Responses. Cognitive Neuroscience and Neuropsychology 13, 14 (2002)Google Scholar
  3. 3.
    Bregman, A.: Auditory Scene Analysis. The MIT Press, Cambridge Massachusetts (1999)Google Scholar
  4. 4.
    Dean, R.T., Whitelaw, M., Smith, H., Worrall, D.: The mirage of real-time algorithmic synaesthesia: Some compositional mechanisms and research agendas in computer music and sonification. Contemporary Music Review 25, 311–327 (2006)CrossRefGoogle Scholar
  5. 5.
    Deutsch, D.: An auditory illusion. Nature 251, 307–309 (1974)CrossRefGoogle Scholar
  6. 6.
    Deutsch, D.: Two-channel listening to musical scales. Journal of the Acoustical Society of America 57, 1156–1160 (1975)CrossRefGoogle Scholar
  7. 7.
    Deutsch, D.: The octave illusion and auditory perceptual integration. Hearing Research and Theory 1, 99–142 (1981)Google Scholar
  8. 8.
    Deutsch, D.: The octave illusion in relation to handedness and familial handedness background. Neuropsychologia 21, 289–293 (1983)CrossRefGoogle Scholar
  9. 9.
    Deutsch, D.: A musical paradox. Music Perception 3, 27–280 (1986)Google Scholar
  10. 10.
    Deutsch, D.: The semitone paradox. Music Perception 6(2), 115–132 (1988)MathSciNetGoogle Scholar
  11. 11.
    Grove, R.: Thinking in Four Dimensions. Melbourne University Press, Melbourne (2005)Google Scholar
  12. 12.
    Marks, L.: On the associations of light and sound: the mediation of brightness, pitch, and loudness. American journal of psychology 87 (1974)Google Scholar
  13. 13.
    McGurk, H., Macdonald, J.: Hearing lips and seeing voices. Nature 264, 746–748 (1976)CrossRefGoogle Scholar
  14. 14.
    Risset, J.-C.: Musical Acoustics. IRCAM, Paris (1972)Google Scholar
  15. 15.
    Risset, J.-C.: Pitch and rhythm paradoxes: Comments on ’Auditory paradox based on fractal waveform’. The journal of the Acoustical Society of America 80(3), 961–962 (1986)CrossRefGoogle Scholar
  16. 16.
    Roads, C.: The Computer Music Tutorial. The MIT Press, Cambridge (1996)Google Scholar
  17. 17.
    Roads, C.: Microsound. The MIT Press, Cambridge (2001)Google Scholar
  18. 18.
    Shams, L.: Integration in the brain - the subconscious alteration of visual perception by cross-modal integration. Science and Consciousness Review 1, 1–4 (2002)CrossRefGoogle Scholar
  19. 19.
    Shams, L., Iwaki, S., Chawla, A., Bhattacharya, J.: Early modulation of visual cortex by sound: an MEG study. Neuroscience Letters 378, 76–81 (2005)CrossRefGoogle Scholar
  20. 20.
    Shams, L., Kamitani, Y., Shimojo, S.: What you see is what you hear. Nature 408, 788 (2000)CrossRefGoogle Scholar
  21. 21.
    Shams, L., Kamitani, Y., Shimojo, S.: Visual illusion induced by sound. Cognitive Brain Research 14, 147–152 (2002)CrossRefGoogle Scholar
  22. 22.
    Shams, L., Ma, W.J., Beierholm, U.: Sound-induced flash illusion as an optimal percept. Neuroreport 16, 17 (2005)CrossRefGoogle Scholar
  23. 23.
    Shepard, R.: Circularity in judgements of relative pitch. Journal of the Acoustical Society of America 36, 2346–2353 (1964)CrossRefGoogle Scholar
  24. 24.
    Shimojo, S., Scheier, C., Nijhawan, R., Shams, L., Kamitani, Y., Watanabe, K.: Beyond perceptual modality: auditory effects on visual perception. Acoustic Science and Technology 22(2), 61–67 (2001)CrossRefGoogle Scholar
  25. 25.
    Shimojo, S., Shams, L.: Sensory modalities are not separate modalities: plasticity and interactions. Current opinion in neurobiology 11, 505–509 (2001)CrossRefGoogle Scholar
  26. 26.
    Shipley, T.: Auditory flutter driving of visual flicker. Science 145, 1328–1330 (1964)CrossRefGoogle Scholar
  27. 27.
    Sinex, D.G.: Cross-modality temporal resolution for auditory, vibrotactile and visual stimuli. Journal of the Acoustical Society of America 63(suppl. 1), 52 (1978)CrossRefGoogle Scholar
  28. 28.
    van Noorden, L.P.A.S.: Minimum differences of level and frequency for perceptual fission of tone sequences ABAB. Journal of the Acoustical Society of America 61(4), 1041–1056 (1977)CrossRefGoogle Scholar
  29. 29.
    Zele, A.J., Vingrys, A.J.: Cathode-ray-tube monitor artefacts in neurophysiology. Journal of Neuroscience Methods 141, 1–7 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Sonia Wilkie
    • 1
  • Catherine Stevens
    • 1
  • Roger Dean
    • 1
  1. 1.MARCS Auditory LaboratoriesUniversity of Western SydneySydneyAustralia

Personalised recommendations