Skip to main content
SpringerLink
Log in

Event-related Potentials in Audio–Visual Cross-Modal Test for Comparison of Word Pairs

  • Published:
Human Physiology Aims and scope Submit manuscript

Abstract

The study was aimed at investigating specificities of brain functioning when comparing verbal signals in cross-modal interaction. Event-related potentials (ERPs) were recorded in 166 healthy subjects in a two-modal, two-stimulus test in the GO–NOGO paradigm where the first stimulus was a visual presentation of the word, and the second stimulus was an auditory presentation of the word. It was shown that while the subjects were waiting for the spoken word to follow the printed word, an activation was recorded in the frontal-temporal area of their left hemisphere (F7, F3), presumably associated with the formation of the word’s phonological representation in the memory. Upon producing the second (spoken) word if it coincides with the visual presentation, the peak activation is recorded in the posterior temporal positions (Т5, Т6) within the interval of 370–500 ms; if the second stimulus does not coincide with the first one, the peak activation is recorded in the occipital positions (O1, O2) within the interval of 590–800 ms. These ERP fluctuations supposedly result from the processes of comparing the newly received auditory information with the phonological representation of the word stored in the working memory.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.

Similar content being viewed by others

REFERENCES

  1. Kropotov J. Quantitative EEG, Event-Related Potentials and Neurotherapy. San Diego, California: Academic Press, 2009.

    Google Scholar 

  2. The Oxford Handbook of Event-Related Potential Components, Luck, S.J. and Kappenman, E.S., Eds., Oxford: Oxford Univ. Press, 2011.

    Google Scholar 

  3. Verleger, R., Paehge, T., Kolev, V., et al., On the relation of movement-related potentials to the go/no-go effect on P3, Biol. Psychol., 2006, vol. 73, no. 3, p. 298.

    Article  Google Scholar 

  4. Vuillier, L., Bryce, D., Szücs, D., and Whitebread, D., The maturation of interference suppression and response inhibition: ERP analysis of a cued Go/Nogo Task, PLoS One, 2016, vol. 11, no. 11, p. e0165697

    Article  Google Scholar 

  5. Walter, W.G., Cooper, R., Aldridge, V.J., et al., Contingent negative variation: an electric sign of sensorimotor association and expectancy in the human brain, Nature, 1964, vol. 203, p. 380.

    Article  CAS  Google Scholar 

  6. Brunia, C.H. and van Boxtel, G.J., Wait and see, Int. J. Psychophysiol., 2001, vol. 43, no. 1, p. 59.

    Article  CAS  Google Scholar 

  7. Tecce, J.J., Contingent negative variation (CNV) and psychological processes in man, Psychol. Bull., 1972, vol. 77, no. 2, p. 73.

    Article  CAS  Google Scholar 

  8. Gomez, C.M., Delinte, A., Vaquero, E., et al., Current source density analysis of CNV during temporal gap paradigm, Brain Topogr., 2001, vol. 13, no. 3, p. 149.

    Article  CAS  Google Scholar 

  9. Taylor, B.K., Gavin, W.J., and Davies, P.L., The test-retest reliability of the visually-evoked contingent negative variation (CNV) in children and adults, Dev. Neuropsychol., 2016, vol. 41, no. 3, p. 162.

    Article  Google Scholar 

  10. Brunia, C.H., Movement and stimulus preceding negativity, Biol. Psychol., 1988, vol. 26, nos. 1–3, p. 165.

    Article  CAS  Google Scholar 

  11. Qiao, Z., Geng, H., Wang, Y., and Li, X., Anticipation of uncertain threat modulates subsequent affective responses and covariation bias, Front. Psychol., 2018, vol. 11, no. 9, art. ID 2547.

    Article  Google Scholar 

  12. Johnen, A.-K. and Harrison, N.R., Level of uncertainty about the affective nature of a pictorial stimulus influences anticipatory neural processes: an event-related potential (ERP) study, Neuropsychologia, 2020, vol. 146, art. ID 107525.

    Article  Google Scholar 

  13. Michalowski, J.M., Pane-Farre, C.A., Low, A., and Hamm, A.O., Brain dynamics of visual attention during anticipation and encoding of threat- and safe-cues in spider-phobic individuals, Soc. Cognit. Affective Neurosci., 2015, vol. 10, no. 9, p. 1177.

    Article  Google Scholar 

  14. Tanovic, E., Pruessner, L., and Joormann, J., Attention and anticipation in response to varying levels of uncertain threat: an ERP study, Cognit., Affective, Behav. Neurosci., 2018, vol. 18, no. 6, p. 1207.

    Article  Google Scholar 

  15. Baddleley, A.D. and Hitch, G.J., Working memory, in Recent Advances in Learning and Motivation, Bower, G., Ed., New York: Academic, 1974, vol. 8, p. 47.

    Google Scholar 

  16. Baddeley, A.D., Working memory: theories, models, and controversies, Annu. Rev. Psychol., 2012, vol. 63, p. 1.

    Article  Google Scholar 

  17. Miller, E.K., Lundqvist, M., and Bastos, A.M., Working memory 2.0, Neuron, 2018, vol. 100, no. 2, p. 463.

    Article  CAS  Google Scholar 

  18. Kropotov, Y.D., Ponomarev, V.A., Pronina, M.V., and Polyakova, N.V., Effects of repetition and stimulus mismatch in sensory visual components of event-related potentials, Hum. Physiol., 2019, vol. 45, no. 4, p. 349.

    Article  Google Scholar 

  19. Chai, W.J., Abd Hamid, A.I., and Abdullah, J.M., Working memory from the psychological and neurosciences perspectives: a review, Front. Psychol., 2018, vol. 9, p. 401.

    Article  Google Scholar 

  20. D’Esposito, M. and Postle, B.R., The cognitive neuroscience of working memory, Rev. Psychol., 2015, vol. 3, no. 66, p. 115.

    Article  Google Scholar 

  21. Nee, D.E. and D’Esposito, M., The representational basis of working memory, Curr. Topics Behav. Neurosci., 2018, vol. 37, p. 213.

    Article  Google Scholar 

  22. Clark, R.E., A history and overview of the behavioral neuroscience of learning and memory, in Behavioral Neuroscience of Learning and Memory, Curr. Topics Behav. Neurosci. vol. 37, Clark, R.E. and Martin, S., Eds., Cham: Springer-Verlag, 2017, p. 1.

  23. Ruchkin, D.S., Berndt, R.S., Johnson, R., Jr., et al., Modality-specific processing streams in verbal working memory: evidence from spatio-temporal patterns of brain activity, Cognit. Brain Res., 1997, vol. 6, no. 2, p. 95.

    Article  CAS  Google Scholar 

  24. Peters, J., Suchan, B., Zhang, Ya., and Daum, I., Visuo-verbal interactions in working memory: evidence from event-related potentials, Cognit. Brain Res., 2005, vol. 25, no. 2, p. 406.

    Article  Google Scholar 

  25. Hidaka, S., Teramoto, W., and Sugita, Y., Spatiotemporal processing in crossmodal interactions for perception of the external world: a review, Front. Integr. Neurosci., 2015, vol. 22, no. 9, p. 62.

    Google Scholar 

  26. Stock, A.K., Gohil, K., Huster, R.J., and Beste, C., On the effects of multimodal information integration in multitasking, Sci. Rep., 2017, vol. 7, no. 1, art. ID 4927.

    Article  Google Scholar 

  27. Tang, X., Wu, J., and Shen, Y., The interactions of multisensory integration with endogenous and exogenous attention, Neurosci. Biobehav. Rev., 2016, vol. 61, p. 208.

    Article  Google Scholar 

  28. Sanders, P., Thompson, B., Corballis, P., and Searchfield, G., On the timing of signals in multisensory integration and crossmodal interactions: a scoping review, Multisens. Res., 2019, vol. 32, no. 6, p. 533.

    Article  Google Scholar 

  29. Kropotov, J.D. and Ponomarev, V.A., Differentiation of neuronal operations in latent components of event-related potentials in delayed match-to-sample tasks, Psychophysiology, 2015, vol. 52, no. 6, p. 826.

    Article  Google Scholar 

  30. Vigário, R.N., Extraction of ocular artifacts from EEG using independent component analysis, Electroencephalogr. Clin. Neurophysiol., 1997, vol. 103, no. 3, p. 395.

    Article  Google Scholar 

  31. Kropotov, Yu.D., Sovremennaya diagnostika i korrektsiya sindroma defitsita vnimaniya (Modern Diagnostics and Correction of Attention Deficit Disorder), St. Petersburg: ELBI-SPb, 2005.

  32. Kropotov, J.D., Ponomarev, V.A., Tereshchenko, E.P., et al., Effect of aging on ERP components of cognitive control, Front. Aging Neurosci., 2016, vol. 8, p. 69.

    Article  Google Scholar 

  33. Smith, E.E. and Jonides, J., Working memory: a view from neuroimaging, Cognit. Psychol., 1997, vol. 33, no. 1, p. 5.

    Article  CAS  Google Scholar 

  34. Brunia, C.H. and van Boxtel, G.J.M., Anticipatory attention to verbal and non-verbal stimuli is reflected in a modality-specific SPN, Exp. Brain Res., 2004, vol. 156, no. 2, p. 231.

    Article  CAS  Google Scholar 

  35. Sinitsyn, S.V., Working memory in young schoolchildren: a study using event-related potentials, Hum. Physiol., 2008, vol. 34, no. 2, p. 250.

    Article  Google Scholar 

Download references

ACKNOWLEDGEMENTS

The authors express their gratitude to Dr. Andreas Muller, Research Centre for Child Health (Chur, Switzerland) for providing ERP recordings of GO–NOGO tests.

Funding

The study was conducted as part of the State Contract with the Ministry of Education and Science of the Russian Federation (no. АААА-А19-119101890066-2).

Author information

Authors and Affiliations

  1. Bechtereva Institute of the Human Brain, Russian Academy of Sciences, 197376, St. Petersburg, Russia

    I. S. Nikishena, V. A. Ponomarev & Yu. D. Kropotov

Authors
  1. I. S. Nikishena
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. V. A. Ponomarev
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yu. D. Kropotov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to I. S. Nikishena.

Ethics declarations

COMPLIANCE WITH ETHICAL STANDARDS

The study was conducted in accordance with the principles of biomedical ethics postulated in the Declaration of Helsinki of 1964 and its later updates and approved by the ethics committee of the Bechtereva Institute of the Human Brain of the Russian Academy of Sciences (St. Petersburg) and the local ethical committee of the Canton of Graubünden (Switzerland).

INFORMED CONSENT

The legal representative of each participant of the study produced a voluntary written informed consent signed after being explained potential risks and advantages, as well as the nature of the forthcoming study.

CONFLICT OF INTERESTS

The authors declare no apparent or potential conflicts of interests associated with the publication of this article.

Additional information

Translated by A. Deryabina

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nikishena, I.S., Ponomarev, V.A. & Kropotov, Y.D. Event-related Potentials in Audio–Visual Cross-Modal Test for Comparison of Word Pairs. Hum Physiol 47, 459–466 (2021). https://doi.org/10.1134/S0362119721020109

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0362119721020109

Keywords:

Search

Navigation