Audiovisual temporal adaptation of speech: temporal order versus simultaneity judgments
- 712 Downloads
The temporal perception of simple auditory and visual stimuli can be modulated by exposure to asynchronous audiovisual speech. For instance, research using the temporal order judgment (TOJ) task has shown that exposure to temporally misaligned audiovisual speech signals can induce temporal adaptation that will influence the TOJs of other (simpler) audiovisual events (Navarra et al. (2005) Cognit Brain Res 25:499–507). Given that TOJ and simultaneity judgment (SJ) tasks appear to reflect different underlying mechanisms, we investigated whether adaptation to asynchronous speech inputs would also influence SJ task performance. Participants judged whether a light flash and a noise burst, presented at varying stimulus onset asynchronies, were simultaneous or not, or else they discriminated which of the two sensory events appeared to have occurred first. While performing these tasks, participants monitored a continuous speech stream for target words that were either presented in synchrony, or with the audio channel lagging 300 ms behind the video channel. We found that the sensitivity of participant’s TOJ and SJ responses was reduced when the background speech stream was desynchronized. A significant modulation of the point of subjective simultaneity (PSS) was also observed in the SJ task but, interestingly, not in the TOJ task, thus supporting previous claims that TOJ and SJ tasks may tap somewhat different aspects of temporal perception.
KeywordsSimultaneity judgment Temporal order judgment Speech Temporal adaptation Audition Vision
A.V. was supported by a Newton Abraham Studentship from the Medical Sciences Division, University of Oxford. S.S.-F., J.N., and C.S. were supported by grants from the McDowell-Pew Foundation, University of Oxford and the Ministerio de Educación y Ciencia from Spain (TIN2004-04363-C03-02).
- Baron J (1969) Temporal ROC curves and the psychological moment. Psychon Sci 15:299–300Google Scholar
- Coren S, Ward LM, Enns JT (2004) Sensation and perception, 6th edn. Harcourt Brace, Fort WorthGoogle Scholar
- Durgin FH, Sternberg S (2002) The time of consciousness and vice versa. Conscious Cogn 11:248–290Google Scholar
- Finney DJ (1964) Probit analysis: statistical treatment of the sigmoid response curve. Cambridge University Press, LondonGoogle Scholar
- Grant KW, Seitz PF (1998) The use of visible speech cues (speechreading) for directing auditory attention: reducing temporal and spectral uncertainty in auditory detection of spoken sentences. In: Kuhl PK, Crum LA (Eds) Proceedings of the 16th international congress on acoustics and the 135th meeting of the acoustical society of America, vol 3. ASA, New York, pp 2335–2336Google Scholar
- Juola JF, van Eijk RLJ, Kohlrausch A, van der Par S (2007) Synchrony detection and temporal order judgments for bimodal stimuli. Poster presented at the joint meeting of the Experimental Psychology Society and The Psychonomics Society. Edinburgh, 4–7 JulyGoogle Scholar
- Spence C (2007) Audiovisual multisensory integration. J Acoust Soc Japan Acoust Sci Technol 28:61–70Google Scholar
- Van de Par S, Kohlrausch A, Juola JF (2002) Some methodological aspects for measuring asynchrony detection in audio–visual stimuli. In: Calvo Manzano A, Perez Lopez A, Santiago JS (eds) Proceedings of the Forum acusticum, Sevilla, Spain, 16–20 September 2002 (on CD-rom). Forum Acusticum, Sevilla, SpainGoogle Scholar
- Van Eijk PLJ, Kohlrausch A, van de Par S, Juola JF (2006) The influence of psychophysical procedure and stimulus type on estimates of human performance in detecting audio–visual asynchrony. Poster presented at the 7th Annual Meeting of the International Multisensory Research Forum, Dublin, IrelandGoogle Scholar
- Welch RB (1999) Meaning, attention, and the “unity assumption” in the intersensory bias of spatial and temporal perceptions. In: Ashersleben G, Bachmann T, Müsseler J (Eds) Cognitive contributions to the perception of spatial and temporal events. Elsevier Science, B.V, Amsterdam, pp 371–387CrossRefGoogle Scholar