Skip to main content
Log in

Tool use changes multisensory interactions in seconds: evidence from the crossmodal congruency task

  • Research Article
  • Published:
Experimental Brain Research Aims and scope Submit manuscript

Abstract

Active tool use in human and non-human primates has been claimed to alter the neural representations of multisensory peripersonal space. To date, most studies suggest that a short period of tool use leads to an expansion or elongation of these spatial representations, which lasts several minutes after the last tool use action. However, the possibility that multisensory interactions also change on a much shorter time scale following or preceding individual tool use movements has not yet been investigated. We measured crossmodal (visual-tactile) congruency effects as an index of multisensory integration during two tool use tasks. In the regular tool use task, the participants used one of two tools in a spatiotemporally predictable sequence after every fourth crossmodal congruency trial. In the random tool use task, the required timing and spatial location of the tool use task varied unpredictably. Multisensory integration effects increased as a function of the number of trials since tool use in the regular tool use group, but remained relatively constant in the random tool use group. The spatial distribution of these multisensory effects, however, was unaffected by tool use predictability, with significant spatial interactions found only near the hands and at the tips of the tools. These data suggest that endogenously preparing to use a tool enhances visual-tactile interactions near the tools. Such enhancements are likely due to the increased behavioural relevance of visual stimuli as each tool use action is prepared before execution.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Ackroyd K, Riddoch MJ, Humphreys GW, Nightingale S, Townsend S (2002) Widening the sphere of influence: using a tool to extend extrapersonal visual space in a patient with severe neglect. Neurocase 8:1–12

    Article  PubMed  Google Scholar 

  • Berti A, Frassinetti F (2000) When far becomes near: remapping of space by tool use. J Cogn Neurosci 12:415–420

    Article  PubMed  CAS  Google Scholar 

  • Bonifazi S, Farnè A, Rinaldesi L, Làdavas E (2007) Dynamic size-change of peri-hand space through tool-use: spatial extension or shift of the multisensory area? J Neuropsychol 1:101–114

    Article  PubMed  CAS  Google Scholar 

  • Costantini M, Bueti D, Pazzaglia M, Aglioti SM (2007) Temporal dynamics of visuo-tactile extinction within and between hemispaces. Neuropsychol 21:242–250

    Article  Google Scholar 

  • Danckert J, Ferber S (2006) Revisiting unilateral neglect. Neuropsychologia 44:987–1006

    Article  PubMed  Google Scholar 

  • Duhamel J-R, Colby CL, Goldberg ME (1998) Ventral intraparietal area of the macaque: congruent visual and somatic response properties. J Neurophysiol 79:126–136

    PubMed  CAS  Google Scholar 

  • Eimer M, van Velzen J (2006) Covert manual response preparation triggers attentional modulations of visual but not auditory processing. Clin Neurophysiol 117:1063–1074

    Article  PubMed  Google Scholar 

  • Eimer M, Forster B, van Velzen J, Prabhu G (2005) Covert manual response preparation triggers attentional shifts: ERP evidence for the premotor theory of attention. Neuropsychologia 43:957–966

    Article  PubMed  Google Scholar 

  • Farnè A, Làdavas E (2000) Dynamic size-change of hand peripersonal space following tool use. NeuroReport 11:1645–1649

    Article  PubMed  Google Scholar 

  • Farnè A, Bonifazi S, Làdavas E (2005a) The role played by tool use and tool-length on the plastic elongation of peri-hand space: a single case study. Cogn Neuropsychol 22:408–418

    Article  Google Scholar 

  • Farnè A, Iriki A, Làdavas E (2005b) Shaping multisensory action-space with tools: evidence from patients with cross-modal extinction. Neuropsychologia 43:238–248

    Article  PubMed  Google Scholar 

  • Farnè A, Serino A, Làdavas E (2007) Dynamic size-change of peri-hand space following tool-use: determinants and spatial characteristics revealed through cross-modal extinction. Cortex 43:436–443

    PubMed  Google Scholar 

  • Forti S, Humphreys GW (2004) Visuomotor cuing through tool use in unilateral visual neglect. J Gen Psychol 131:379–410

    PubMed  Google Scholar 

  • Graziano MSA, Cooke DF (2006) Parieto-frontal interactions, personal space, and defensive behavior. Neuropsychologia 44:845–859

    Article  PubMed  Google Scholar 

  • Graziano MSA, Hu XT, Gross CG (1997) Visuospatial properties of ventral premotor cortex. J Neurophysiol 77:2268–2292

    PubMed  CAS  Google Scholar 

  • Handy TC, Borg JS, Turk DJ, Tipper CM, Grafton ST, Gazzaniga MS (2005) Placing a tool in the spotlight: spatial attention modulates visuomotor responses in cortex. NeuroImage 26:266–276

    Article  PubMed  Google Scholar 

  • Holmes NP, Spence C (2004) The body schema and multisensory representation(s) of peripersonal space. Cogn Process 5:94–105

    Article  PubMed  Google Scholar 

  • Holmes NP, Spence C (2006) Beyond the body schema: visual, prosthetic, and technological contributions to bodily perception and awareness. In: Knoblich G, Thornton I, Grosjean M, Shiffrar M (eds) Human body perception from the inside out. Oxford University Press, Oxford, pp. 15–64

    Google Scholar 

  • Holmes NP, Calvert GA, Spence C (2004) Extending or projecting peripersonal space with tools? Multisensory interactions highlight only the distal and proximal ends of tools. Neurosci Lett 372:62–67

    Article  PubMed  CAS  Google Scholar 

  • Holmes NP, Sanabria D, Calvert GA, Spence C (2007) Tool-use: capturing multisensory spatial attention or extending multisensory peripersonal space? Cortex 43:469–489

    PubMed  Google Scholar 

  • Humphreys GW, Riddoch MJ, Forti S, Ackroyd K (2004) Action influences spatial perception: neuropsychological evidence. Vis Cogn 11:411–427

    Google Scholar 

  • Iriki A, Tanaka M, Iwamura Y (1996a) Coding of modified body schema during tool use by macaque postcentral neurons. NeuroReport 7:2325–2330

    Article  PubMed  CAS  Google Scholar 

  • Iriki A, Tanaka M, Iwamura Y (1996b) Attention-induced neuronal activity in the monkey somatosensory cortex revealed by pupillometrics. Neurosci Res 25:173–181

    PubMed  CAS  Google Scholar 

  • Iriki A, Tanaka M, Obayashi S, Iwamura Y (2001) Self-images in the video monitor coded by monkey intraparietal neurons. Neurosci Res 40:163–173

    Article  PubMed  CAS  Google Scholar 

  • Làdavas E (2002) Functional and dynamic properties of visual peripersonal space. Trends Cogn Sci 6:17–22

    Article  Google Scholar 

  • Làdavas E, di Pellegrino G, Farnè A, Zeloni G (1998) Neuropsychological evidence of an integrated visuotactile representation of peripersonal space in humans. J Cogn Neurosci 10:581–589

    Article  PubMed  Google Scholar 

  • Longo MR, Lorenco SF (2006) On the nature of near space: effects of tool use and the transition to far space. Neuropsychologia 44:977–981

    Article  PubMed  Google Scholar 

  • Maravita A (2006) From body in the brain, to body in space: sensory and intentional aspects of body representation. In: G Knoblich M Shiffrar M Grosjean (eds) The human body: perception from the inside out. Oxford University Press, Oxford, pp. 65–88

    Google Scholar 

  • Maravita A, Iriki A (2004) Tools for the body (schema). Trends Cogn Sci 8:79–86

    Article  PubMed  Google Scholar 

  • Maravita A, Husain M, Clarke K, Driver J (2001) Reaching with a tool extends visual-tactile interactions into far space: evidence from cross-modal extinction. Neuropsychologia 39:580–585

    Article  PubMed  CAS  Google Scholar 

  • Maravita A, Clarke K, Husain M, Driver J (2002a) Active tool use with contralesional hand can reduce crossmodal extinction of touch on that hand. Neurocase 8:411–416

    Article  PubMed  Google Scholar 

  • Maravita A, Spence C, Kennett S, Driver J (2002b) Tool use changes multimodal spatial interactions between vision and touch in normal humans. Cognition 83:25–34

    Article  Google Scholar 

  • Obayashi S, Tanaka M, Iriki A (2001) Subjective image of invisible hand coded by monkey intraparietal neurons. Neuro Report 11:3499–3505

    Google Scholar 

  • Pavani F, Castiello U (2004) Binding personal and extrapersonal space through body shadows. Nat Neurosci 7:13–14

    Article  CAS  Google Scholar 

  • Pegna AJ, Petit L, Caldara-Schnetzer A-S, Khateb A, Annoni J-M, Sztajzel R, Landis T (2001) So near yet so far: neglect in far or near space depends on tool use. Ann Neurol 50:820–822

    Article  PubMed  CAS  Google Scholar 

  • Poliakoff E, Ashworth S, Lowe C, Spence C (2006) Vision and touch in ageing: crossmodal selective attention and visuotactile spatial interactions. Neuropsychologia 44:507–517

    Article  PubMed  CAS  Google Scholar 

  • Sarri M, Blankenburg F, Driver J (2006) Neural correlates of crossmodal visual-tactile extinction and of tactile awareness revealed by fMRI in a right-hemisphere stroke patient. Neuropsychologia 44:2398–2410

    Article  PubMed  Google Scholar 

  • Shore DI, Barnes ME, Spence C (2006) Temporal aspects of the visuotactile congruency effect. Neurosci Lett 392:96–100

    Article  PubMed  CAS  Google Scholar 

  • Soto-Faraco S, Ronald A, Spence C (2004) Tactile selective attention and body posture: assessing the multisensory contributions of vision and proprioception. Percept Psychophys 66:1077–1094

    PubMed  Google Scholar 

  • Soto-Faraco S, Dalton P, Gallace A, Kreukniet B, Spence C (2007). The representation of tactile space in a multisensory body. Percept Psychophys (Submitted)

  • Spence C, Pavani F, Driver J (2004a) Spatial constraints on visual-tactile cross-modal distractor congruency effects. Cogn Affect Behav Neurosci 4:148–169

    Article  PubMed  Google Scholar 

  • Spence C, Pavani F, Maravita A, Holmes N (2004b) Multisensory contributions to the 3-D representation of visuotactile peripersonal space in humans: evidence from the crossmodal congruency task. J Physiol (Paris) 98:171–189

    Article  Google Scholar 

  • Townsend JT, Ashby FG (1983) Stochastic modelling of elementary psychological processes. Cambridge University Press, New York

    Google Scholar 

  • van Selst M, Jolicoeur P (1994) A solution to the effect of sample size on outlier elimination. Q J Exp Psychol A 47:631–650

    Google Scholar 

  • Weiss PH, Marshall JC, Wunderlich G, Tellmann L, Halligan PW, Freund H-J, Zilles K, Fink GR (2000) Neural consequences of acting in near versus far space: a physiological basis for clinical dissociations. Brain 123:2531–3541

    Article  PubMed  Google Scholar 

  • Yamamoto S, Kitazawa S (2001) Sensation at the tips of invisible tools. Nature Neurosci 4:979–980

    Article  PubMed  CAS  Google Scholar 

  • Yamamoto S, Moizumi S, Kitazawa S (2005) Referral of tactile sensation to the tips of L-shaped sticks. J Neurophysiol 93:2856–2863

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

N. P. H. was supported by a Wellcome Trust Prize Studentship (number 065696/Z/01/A), and a Science Research Fellowship from the Royal Commission for the Exhibition of 1851. G. A. C. was supported by a Career Development Award from The Wellcome Trust. We thank Matthew Longo, Alessandro Farnè, and several anonymous commentators and reviewers for very thorough and helpful comments on previous versions of the manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nicholas P. Holmes.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Holmes, N.P., Calvert, G.A. & Spence, C. Tool use changes multisensory interactions in seconds: evidence from the crossmodal congruency task. Exp Brain Res 183, 465–476 (2007). https://doi.org/10.1007/s00221-007-1060-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00221-007-1060-7

Keywords

Navigation