Cross-modal decoupling in temporal attention between audition and touch
Temporal orienting leads to well-documented behavioural benefits for sensory events occurring at the anticipated moment. However, the consequences of temporal orienting in cross-modal contexts are still unclear. On the one hand, some studies using audio-tactile paradigms suggest that attentional orienting in time and modality are a closely coupled system, in which temporal orienting dominates modality orienting, similar to what happens in cross-modal spatial attention. On the other hand, recent findings using a visuo-tactile paradigm suggest that attentional orienting in time can unfold independently in each modality, leading to cross-modal decoupling. In the present study, we investigated if cross-modal decoupling in time can be extrapolated to audio-tactile contexts. If so, decoupling might represent a general property of cross-modal attention in time. To this end, we used a speeded discrimination task in which we manipulated the probability of target presentation in time and modality. In each trial, a manipulation of time-based expectancy was used to guide participants’ attention to task-relevant events, either tactile or auditory, at different points in time. In two experiments, we found that participants generally showed enhanced behavioural performance at the most likely onset time of each modality and no evidence for coupling. This pattern supports the hypothesis that cross-modal decoupling could be a general phenomenon in temporal orienting.
This research was funded by the Spanish Ministry of Science and Innovation (PSI2016-75558-P(AEI/FEDER)), the Comissionat per a Universitats i Recerca del DIUE-Generalitat de Catalunya (2014SGR856), and the European Research Council (StG-2010 263145) to S.S.F.
Conflict of interest
The authors declare that they have no conflict of interest.
- Bauer, M., Kennett, S., & Driver, J. (2012). Attentional selection of location and modality in vision and touch modulates low-frequency activity in associated sensory cortices. Journal of Neurophysiology, 107(9), 2342–2351. https://doi.org/10.1152/jn.00973.2011.CrossRefPubMedPubMedCentralGoogle Scholar
- Coull, J. T., & Nobre, A. C. (1998). Where and when to pay attention: the neural systems for directing attention to spatial locations and to time intervals as revealed by both PET and fMRI. The Journal of Neuroscience, 18(18), 7426–7435. http://www.ncbi.nlm.nih.gov/pubmed/9736662.
- Cravo, A. M., Rohenkohl, G., Wyart, V., & Nobre, A. C. (2013). Temporal expectation enhances contrast sensitivity by phase entrainment of low-frequency oscillations in visual cortex. The Journal of Neuroscience, 33(9), 4002–4010. https://doi.org/10.1523/JNEUROSCI.4675-12.2013.CrossRefPubMedPubMedCentralGoogle Scholar
- Desimone, R., & Duncan, J. (1995). Neural mechanisms of selective visual attention. Annual Reviews of Neuroscience, 18, 193–222. http://www.annualreviews.org/doi/pdf/10.1146/annurev.ne.18.030195.001205.Google Scholar
- Driver, J., & Spence, C. (1994). Spatial synergies between auditory and visual attention. In C. Umiltà & M. Moscovitch (Eds.), Attention and performance XV: Conscious and nonconscious information processing (pp. 311–331). Cambridge: MIT Press.Google Scholar
- Eimer, M. (1999). Can attention be directed to opposite locations in different modalities? An ERP study. Clinical Neurophysiology, 110(7), 1252–1259. http://www.ncbi.nlm.nih.gov/pubmed/10423190.
- Eimer, M., & Driver, J. (2000). An event-related brain potential study of cross-modal links in spatial attention between vision and touch. Psychophysiology, 37(5), 697–705. http://www.ncbi.nlm.nih.gov/pubmed/11037046.
- Eimer, M., van Velzen, J., & Driver, J. (2002). Cross-modal interactions between audition, touch, and vision in endogenous spatial attention: ERP evidence on preparatory states and sensory modulations. Journal of Cognitive Neuroscience, 14(2), 254–271. https://doi.org/10.1162/089892902317236885.CrossRefPubMedGoogle Scholar
- Kennett, S., Eimer, M., Spence, C., & Driver, J. (2001). Tactile-visual links in exogenous spatial attention under different postures: convergent evidence from psychophysics and ERPs. Journal of Cognitive Neuroscience, 13(4), 462–478. http://www.ncbi.nlm.nih.gov/pubmed/11388920.
- Kubovy, M. (1988). Should we resist the seductiveness of the space is to time as vision is to audition analogy? Journal of Experimental Psychology: Human Perception and Performance, 14(2), 318–320.Google Scholar
- Lange, K. (2013). The ups and downs of temporal orienting: a review of auditory temporal orienting studies and a model associating the heterogeneous findings on the auditory N1 with opposite effects of attention and prediction. Frontiers in Human Neuroscience, 7(June), 263. https://doi.org/10.3389/fnhum.2013.00263.PubMedPubMedCentralGoogle Scholar
- Lange, K., Rösler, F., & Röder, B. (2003). Early processing stages are modulated when auditory stimuli are presented at an attended moment in time: an event-related potential study. Psychophysiology, 40(5), 806–817. http://www.ncbi.nlm.nih.gov/pubmed/14696734.
- Liu, Y., Bengson, J., Huang, H., Mangun, G. R., & Ding, M. (2014). Top-down Modulation of Neural Activity in Anticipatory Visual Attention: Control Mechanisms Revealed by Simultaneous EEG-fMRI. Cerebral Cortex (New York, N.Y.: 1991), (February), pp. 517–529. https://doi.org/10.1093/cercor/bhu204.Google Scholar
- Miniussi, C., Wilding, E. L., Coull, J. T., & Nobre, A. C. (1999). Orienting attention in time. Modulation of brain potentials. Brain, 122, 1507–1518. http://www.ncbi.nlm.nih.gov/pubmed/10430834.
- Nobre, A. C., & Rohenkohl, G. (2014). Time for the fourth dimension of attention. In A. C. Nobre & S. Kastner (Eds.), The Oxford Handbook of Attention (pp. 676–724). Oxford: Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199675111.013.036.CrossRefGoogle Scholar
- Pomper, U., Keil, J., Foxe, J. J., & Senkowski, D. (2015). Intersensory selective attention and temporal orienting operate in parallel and are instantiated in spatially distinct sensory and motor cortices. Human Brain Mapping, 3259, 3246–3259. https://doi.org/10.1002/hbm.22845.CrossRefGoogle Scholar
- Schröter, H., Birngruber, T., Bratzke, D., Miller, J., & Ulrich, R. (2015). Task predictability influences the variable foreperiod effect: evidence of task-specific temporal preparation. Psychological Research Psychologische Forschung, 79(2), 230–237. https://doi.org/10.1007/s00426-014-0550-z.CrossRefPubMedGoogle Scholar
- Schwartze, M., Farrugia, N., & Kotz, S. A. (2013). Dissociation of formal and temporal predictability in early auditory evoked potentials. Neuropsychologia, 51(2), 320–325. https://doi.org/10.1016/j.neuropsychologia.2012.09.037.CrossRefPubMedGoogle Scholar
- Soto-Faraco, S., Morein-Zamir, S., & Kingstone, A. (2005). On audiovisual spatial synergy: the fragility of the phenomenon. Perception & Psychophysicssychophysics, 67(3), 444–457. http://www.ncbi.nlm.nih.gov/pubmed/16119393.
- Spence, C., & Driver, J. (1997). On measuring selective attention to an expected sensory modality. Perception & Psychophysics, 59(3), 389–403. http://www.ncbi.nlm.nih.gov/pubmed/9136269.
- Spence, C., Nicholls, M. E. R., & Driver, J. (2001). The cost of expecting events in the wrong sensory modality. Perception & Psychophysics, 63(2), 330–336. http://www.ncbi.nlm.nih.gov/pubmed/11281107.
- Störmer, V. S., McDonald, J. J., & Hillyard, S. a. (2009). Cross-modal cueing of attention alters appearance and early cortical processing of visual stimuli. Proceedings of the National Academy of Sciences of the United States of America, 106(52), 22456–22461. https://doi.org/10.1073/pnas.0907573106.CrossRefPubMedPubMedCentralGoogle Scholar
- Trenner, M. U., Heekeren, H. R., Bauer, M., Rössner, K., Wenzel, R., Villringer, A., & Fahle, M. (2008). What happens in between? Human oscillatory brain activity related to crossmodal spatial cueing. PloS One, 3(1), e1467. https://doi.org/10.1371/journal.pone.0001467.CrossRefPubMedPubMedCentralGoogle Scholar
- van Ede, F., de Lange, F., Jensen, O., & Maris, E. (2011). Orienting attention to an upcoming tactile event involves a spatially and temporally specific modulation of sensorimotor alpha- and beta-band oscillations. Journal of Neuroscience, 31(6), 2016–2024. https://doi.org/10.1523/JNEUROSCI.5630-10.2011.CrossRefPubMedGoogle Scholar